Observable Patterns Are Not Explanations: A Causal-Geometric Analysis of Latent Reasoning Models

Darpan Aswal, Thomas Palmeira Ferraz, Yongxin Zhou, Maxime Peyrard


Abstract
Latent reasoning models (LRMs) replace explicit chain-of-thought with continuous thoughts. Recent work treats observable latent-state patterns, such as BFS-like frontiers and decodable arithmetic computation, as evidence for internal reasoning mechanisms. Evaluating two LRMs (Coconut and CODI) against controls lacking the proposed recurrence or curriculum, we find these patterns also appear in the controls and do not consistently affect behavior. Causal interventions reveal that latent-thought utilization is not binary but graded, scaling with a thought’s causal effect on model behavior. Geometric analyses reveal this effect concentrates in low-dimensional subspaces whose step-wise geometry grows more structured as their behavioral influence increases. Latent thoughts should therefore be treated as hidden computation, not hidden explanation: decodability, attention, or static structure alone cannot establish LRM reasoning mechanisms; that requires matched controls and causal tests.
Anthology ID:
2026.emnlp-main.83
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
1898–1938
Language:
URL:
https://aclanthology.org/2026.emnlp-main.83/
DOI:
Bibkey:
Cite (ACL):
Darpan Aswal, Thomas Palmeira Ferraz, Yongxin Zhou, and Maxime Peyrard. 2026. Observable Patterns Are Not Explanations: A Causal-Geometric Analysis of Latent Reasoning Models. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 1898–1938, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Observable Patterns Are Not Explanations: A Causal-Geometric Analysis of Latent Reasoning Models (Aswal et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.83.pdf