Tokenizer Artefacts Behind Arithmetic and Spelling Failures

The Strawberry Problem: why LLMs can pass tests but can't count letters

Large Language Models process input through a tokenization mechanism that maps sequences of characters to continuous vector embeddings rather than preserving discrete character-level fidelity. This a…