FineVerify: Scaling Test-Time Compute with Fine-Grained Self-Verification for Agentic Search

James Xu Zhao, Hui Chen, Bryan Hooi, See-Kiong Ng


Abstract
Agentic search requires language model agents to explore many sources and answer complex information-seeking questions. Scaling test-time compute is a promising way to improve these agents, but current approaches can fail, because correct answers are often sparse and score-based selection depends on model calibration. We propose FineVerify, a fine-grained self-verification framework that decomposes each question into checkable sub-questions, verifies sampled candidates against each sub-question, and selects the candidate with the highest aggregated score. This per-check structure turns selection into simpler local judgments and produces scores under the same explicit criteria. Across four agentic search benchmarks and two models, FineVerify consistently outperforms standard scaling baselines. With only four sampled trajectories, it improves GPT-5-mini by 8.2 accuracy points and Gemini-3-flash by 5.6% on average. With 12 samples, FineVerify enables GPT-5-mini to surpass frontier GPT-5 on BrowseComp-Plus. Beyond accuracy, FineVerify produces interpretable verification traces that help audit benchmark errors, suggesting broader applications for inspecting agentic search systems.
Anthology ID:
2026.emnlp-main.2599
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
59033–59062
Language:
URL:
https://aclanthology.org/2026.emnlp-main.2599/
DOI:
Bibkey:
Cite (ACL):
James Xu Zhao, Hui Chen, Bryan Hooi, and See-Kiong Ng. 2026. FineVerify: Scaling Test-Time Compute with Fine-Grained Self-Verification for Agentic Search. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 59033–59062, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
FineVerify: Scaling Test-Time Compute with Fine-Grained Self-Verification for Agentic Search (Zhao et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.2599.pdf