StatefulDiscovery: Evidence-Calibrated Claim Formation in Open-Ended Scientific Discovery

Jiayao Chen, Shi Liu, Linyi Yang


Abstract
Open-ended scientific discovery asks agents to move beyond executing analyses for predefined questions. Across multiple rounds of exploration, a discovery agent must decide which phenomena warrant investigation while avoiding overinterpretation, where emerging claims exceed the evidential scope of the analyses. This creates an evidence-calibration problem: the exploration trajectory must be coupled with claim status so that evidence can guide both what to investigate next and what can be claimed. We introduce StatefulDiscovery, a discovery framework that externalizes investigation state and uses it to coordinate frontier selection, evidence acquisition, and claim adjudication. We evaluate StatefulDiscovery across 40 real-data discovery tasks. Compared with several baselines, StatefulDiscovery produces more claims overall judged to be both well-supported and high-value. Ablations indicate distinct roles for structured hypotheses, local adjudication, frontier control and persistent states. Together, these results suggest that explicit discovery state can couple exploration with evidence-calibrated claim formation.
Anthology ID:
2026.findings-emnlp.665
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
13953–13977
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.665/
DOI:
Bibkey:
Cite (ACL):
Jiayao Chen, Shi Liu, and Linyi Yang. 2026. StatefulDiscovery: Evidence-Calibrated Claim Formation in Open-Ended Scientific Discovery. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 13953–13977, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
StatefulDiscovery: Evidence-Calibrated Claim Formation in Open-Ended Scientific Discovery (Chen et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.665.pdf