Which Mathematical Context Supports Target-Aligned Conjecture Generation? A Paired Ablation Study

Austin LaHue, Michael Burr, Luis David Garcia Puente, Vinita Gangaram Jansari, Benjamin E Nye, Carlos Toxtli Hernandez


Abstract
Generating mathematical conjectures from natural-language context is challenging because theorem-relevant information is distributed across multiple forms of mathematical context, including definitions, objects, assumptions, and constructions. We study which of these contextual signals help a model recover the specific claim supported by the surrounding setup, using 61 main theorems from 12 papers across four mathematical domains. For each theorem, we redact the result and represent the remaining setup using six context components. A paired ablation design compares full context, six leave-one-out conditions, and six single-component conditions, yielding 793 generated conjectures. Context components were largely complementary: removing one component usually had little effect, whereas retaining only one substantially reduced expected-theorem alignment. Local Mathematical Objects provided the strongest standalone signal, while Structural Constraints and Conditions produced the largest alignment decrease when removed. These findings suggest that target-aligned conjecture generation depends on combining information that identifies relevant objects with information that constrains admissible claims.
Anthology ID:
2026.mathnlp-main.11
Volume:
The Proceedings of the 4th Workshop on Mathematical Natural Language Processing (MathNLP 2026)
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Marco Valentino, Deborah Ferreira, Mokanarangan Thayaparan, Leonardo Ranaldi, Jo-Ku Cheng, Andre Freitas
Venues:
MathNLP | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
136–151
Language:
URL:
https://aclanthology.org/2026.mathnlp-main.11/
DOI:
Bibkey:
Cite (ACL):
Austin LaHue, Michael Burr, Luis David Garcia Puente, Vinita Gangaram Jansari, Benjamin E Nye, and Carlos Toxtli Hernandez. 2026. Which Mathematical Context Supports Target-Aligned Conjecture Generation? A Paired Ablation Study. In The Proceedings of the 4th Workshop on Mathematical Natural Language Processing (MathNLP 2026), pages 136–151, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Which Mathematical Context Supports Target-Aligned Conjecture Generation? A Paired Ablation Study (LaHue et al., MathNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.mathnlp-main.11.pdf