When Symbolic Analyses Mislead: Resolution Sensitivity in Neural Language Representations

Matthew Fried


Abstract
Recent representation analyses have reported structure-like or invariant behavior even in randomly initialized transformers, motivating the interpretation that aspects of linguistic structure may be architectural rather than learned. We show that such conclusions can be artifacts of coarse symbolic discretization. We formalize symbolic analysis of neural representations as operating over discretized activation trajectories and identify symbolic resolution as a critical, previously uncontrolled variable. Varying resolution reveals a sharp collapse of apparent similarity in random models, while pretrained models maintain stable, operator-selective differentiation across all tested resolutions. We introduce resolution stability as a necessary validity criterion for symbolic and automata-based analyses, providing a falsifiable, architecture-agnostic diagnostic for auditing internal linguistic structure in neural language models.
Anthology ID:
2026.findings-emnlp.9
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
163–172
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.9/
DOI:
Bibkey:
Cite (ACL):
Matthew Fried. 2026. When Symbolic Analyses Mislead: Resolution Sensitivity in Neural Language Representations. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 163–172, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
When Symbolic Analyses Mislead: Resolution Sensitivity in Neural Language Representations (Fried, Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.9.pdf