Test-Time Scaling for Scientific Equation Discovery

Haowei Lin, Hubert Lim, Xiangyu Wang, Letian Huang, Di He


Abstract
Test-time scaling (TTS) improves language model reasoning by allocating additional test-time compute, but prior work mainly studies closed-ended tasks such as math and coding. We study TTS for automated equation discovery, an open-ended setting where models search over candidate equations and rely on observed datapoints for feedback. We formulate LLM-driven equation discovery as an iterative search process that unifies Best-of-N, sequential refinement, tree search, and evolution-style methods under a common compute-allocation view. To isolate allocation effects from prompt engineering and other heuristics, we compare minimal parallel controllers under fixed budgets. On LLM-SRBench equation-discovery tasks, we find that search width is the dominant allocation parameter: the best width in our sweep generally increases with the compute budget, while the population–branching split and controller choice matter less. Appropriate width selection also improves wall-clock efficiency by increasing parallelism. These results suggest that, given an informative verifier, controlling exploration and exploitation is central to scaling LLM-based equation discovery.
Anthology ID:
2026.emnlp-main.354
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
8122–8143
Language:
URL:
https://aclanthology.org/2026.emnlp-main.354/
DOI:
Bibkey:
Cite (ACL):
Haowei Lin, Hubert Lim, Xiangyu Wang, Letian Huang, and Di He. 2026. Test-Time Scaling for Scientific Equation Discovery. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 8122–8143, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Test-Time Scaling for Scientific Equation Discovery (Lin et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.354.pdf