Same Text, Different Transitions: Action Insufficiency in Lean Provers

Edison Yang, Neel Marripalapu, Akshaj Agadi, Andrew Kim


Abstract
Neural Lean provers usually give the model only the printed text of a proof state, and some searches reuse it to decide when two states are the same. Both uses assume that states printing identically behave identically under the same tactic. We show that this assumption fails. Searching Mathlib, we find 70 verified classes of identically printed states; in 68 of them, one tactic succeeds on one member and fails on another, yielding 103 contradictory cases verified by Lean. Controlled experiments trace the difference to elaborated structure that Lean’s notation hides, and reproduce it on current Lean and Mathlib. A compact structural representation recovers the missing signal for mechanisms seen in training and fails to transfer to unseen ones. In a constructed benchmark with a known proof, merging states by identical text discards that proof in 48.4% of alias arrivals, while a structural identity prevents every loss at 8% runtime overhead. This rate is conditional on meeting an alias; in blind sampling, confirmed aliases arise at only 0.29% of search roots. Text written for people is thus not necessarily a safe identifier for machine state, and we suggest giving the model that text while identifying search states by structure.
Anthology ID:
2026.mathnlp-main.18
Volume:
The Proceedings of the 4th Workshop on Mathematical Natural Language Processing (MathNLP 2026)
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Marco Valentino, Deborah Ferreira, Mokanarangan Thayaparan, Leonardo Ranaldi, Jo-Ku Cheng, Andre Freitas
Venues:
MathNLP | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
240–253
Language:
URL:
https://aclanthology.org/2026.mathnlp-main.18/
DOI:
Bibkey:
Cite (ACL):
Edison Yang, Neel Marripalapu, Akshaj Agadi, and Andrew Kim. 2026. Same Text, Different Transitions: Action Insufficiency in Lean Provers. In The Proceedings of the 4th Workshop on Mathematical Natural Language Processing (MathNLP 2026), pages 240–253, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Same Text, Different Transitions: Action Insufficiency in Lean Provers (Yang et al., MathNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.mathnlp-main.18.pdf