Numbers Through Signs: How LLMs Connect Counts, Number Words, and Numerals

J. Albert Yoo


Abstract
Large language models manipulate numerical expressions fluently, yet it is unclear whether a number inferred from a collection enters the same internal interface as an explicit numeral or number word. We test digits, English number words, and counts of repeated tokens in five Qwen3 base models from 0.6B to 14B. After each quantity expression but before a comparison, parity, or equality question, we interchange one residual-stream state between forms. Textual-count states preserve held-out cardinal order, even at fixed sequence length. In behaviourally competent 8B and 14B cases, digit and number-word states are bidirectionally interchangeable. At the tested collection boundary, however, a count state does not transfer even to a different count of the same form, and no count–sign direction meets the same one-shot criteria. A same-depth sweep and symbol-derived linear subspace do not recover a bidirectional local interface. Longer interventions and a separate mixture-of-experts model reveal strong but directional bridges. Counting information and correct behaviour can therefore coexist without a locally portable state at the tested boundary.
Anthology ID:
2026.mathnlp-main.21
Volume:
The Proceedings of the 4th Workshop on Mathematical Natural Language Processing (MathNLP 2026)
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Marco Valentino, Deborah Ferreira, Mokanarangan Thayaparan, Leonardo Ranaldi, Jo-Ku Cheng, Andre Freitas
Venues:
MathNLP | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
285–290
Language:
URL:
https://aclanthology.org/2026.mathnlp-main.21/
DOI:
Bibkey:
Cite (ACL):
J. Albert Yoo. 2026. Numbers Through Signs: How LLMs Connect Counts, Number Words, and Numerals. In The Proceedings of the 4th Workshop on Mathematical Natural Language Processing (MathNLP 2026), pages 285–290, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Numbers Through Signs: How LLMs Connect Counts, Number Words, and Numerals (Yoo, MathNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.mathnlp-main.21.pdf