Structural Signatures of Correct Mathematical Reasoning Traces

Maria Marina, Alexander Panchenko


Abstract
Self-consistency improves reasoning by voting over sampled final answers, but the vote discards how those answers were reached. We ask whether the internal organization of traces provides an interpretable signal that frequency misses. For each candidate answer, we cluster recurring intermediate statements into semantic checkpoints, retain checkpoint orders that are consistent across traces, and identify relations that appear both directly and with intermediate checkpoints inserted. These relations form answer-local shortcut graphs. Our score is the number of graph edges beyond a spanning tree in the most cross-linked component, normalized by answer frequency and smoothed over nearby sampling budgets. The intuition is deliberately structural: correct traces may agree on core dependencies while varying in local decomposition, whereas a wrong majority can arise from repeated copies of one failure route. On Math500 dataset, the structural selector is mostly neutral when evidence is scarce, but after sufficient sampling it frequently repairs majority errors, reaching up to 2% increase over majority vote scores.
Anthology ID:
2026.mathnlp-main.15
Volume:
The Proceedings of the 4th Workshop on Mathematical Natural Language Processing (MathNLP 2026)
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Marco Valentino, Deborah Ferreira, Mokanarangan Thayaparan, Leonardo Ranaldi, Jo-Ku Cheng, Andre Freitas
Venues:
MathNLP | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
194–200
Language:
URL:
https://aclanthology.org/2026.mathnlp-main.15/
DOI:
Bibkey:
Cite (ACL):
Maria Marina and Alexander Panchenko. 2026. Structural Signatures of Correct Mathematical Reasoning Traces. In The Proceedings of the 4th Workshop on Mathematical Natural Language Processing (MathNLP 2026), pages 194–200, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Structural Signatures of Correct Mathematical Reasoning Traces (Marina & Panchenko, MathNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.mathnlp-main.15.pdf