
Characters, Tokens and Embeddings
When building retrieval-augmented systems for WooCommerce stores, three measurements are easy to confuse: characters, tokens, and embeddings. They describe different stages of the content pipeline, and choosing the wrong one can lead to oversized chunks, incomplete product context, higher API costs, or poor search results. Characters are a simple size estimate A character is a letter, number, space, punctuation mark, or other symbol in a text string. Character counts are easy to calculate and useful for initial inspection after a document has been parsed. For example, a product description might contain 4,800 characters, including HTML text, headings, specifications, and line breaks. That number tells you how large the raw string is, but it does not reliably tell you how much context a language model will














































