HypoExplore: Agentic Discovery with Active Hypothesis Exploration

Jaywon Koo, Jefferson Hernandez, Ruozhen He, Hanjie Chen, Chen Wei, Vicente Ordonez


Abstract
We introduce HypoExplore, an agentic framework that formulates model discovery as a hypothesis-driven scientific inquiry. Given a human-specified high-level research direction, HypoExplore ideates, implements, evaluates, and improves neural architectures through evolutionary branching. Hypotheses are generated using a large language model by selecting a parent hypothesis to build upon, guided by a dual strategy that balances exploiting validated principles with resolving uncertain ones. Our proposed framework maintains a Trajectory Tree that records the lineage of all proposed architectures, and a Hypothesis Memory Bank that actively tracks associated confidence scores acquired through experimental evidence. After each experiment, multiple feedback agents analyze the results from different perspectives and consolidate their findings into hypothesis confidence updates. Under minimal research directions, HypoExplore discovers a model that achieves top results on two medical imaging tasks on MedMNIST, an improved encoder for named entity recognition on FiNER-ORD, and a lightweight 0.7M parameter model on CIFAR-10 that reaches 94.1% accuracy and transfers well to other benchmarks. Our analysis of hypothesis confidence scores across evolutionary lineages suggest that HypoExplore not only discovers stronger architectures, but can help build a genuine understanding of the design space.
Anthology ID:
2026.findings-emnlp.2285
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
48955–48997
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.2285/
DOI:
Bibkey:
Cite (ACL):
Jaywon Koo, Jefferson Hernandez, Ruozhen He, Hanjie Chen, Chen Wei, and Vicente Ordonez. 2026. HypoExplore: Agentic Discovery with Active Hypothesis Exploration. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 48955–48997, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
HypoExplore: Agentic Discovery with Active Hypothesis Exploration (Koo et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.2285.pdf