Iterate Until Retrieved: Factual Nugget Optimization for Discoverable Continual Corrections in Agentic RAG

Moshe Hazoom, Gal Patel, Alon Talmor, Tom Hope


Abstract
Agentic retrieval-augmented generation (RAG) systems in business-to-business settings may often receive free-form response feedback. Rather than generic feedback signals such as style, preference, or overall response quality, we focus on actionable factual corrections. We identify these instances and convert them into compact knowledge-base entries, which we call factual nuggets. We introduce Iterative Nugget Optimization (INO), an index-time optimization method that uses the production agentic RAG as a test harness: it creates an initial nugget, probes it with the triggering query and paraphrases, reflects over failed retrieval and answer traces, and revises the nugget until it is discoverable. We evaluate INO with two production B2B knowledge-assistance agents across multiple companies that use our system: a product support agent that answers questions over company-specific knowledge bases, and a support ticket agent that assists support engineers. INO consistently improves results over baselines in terms of discoverability and usage of factual corrections, in automated and human evaluations. A controlled experiment in production shows that the nuggets improve user satisfaction with responses.
Anthology ID:
2026.emnlp-industry.196
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Pepa Atanasova, Gholamreza Haffari, Minghan Wang
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
3297–3307
Language:
URL:
https://aclanthology.org/2026.emnlp-industry.196/
DOI:
Bibkey:
Cite (ACL):
Moshe Hazoom, Gal Patel, Alon Talmor, and Tom Hope. 2026. Iterate Until Retrieved: Factual Nugget Optimization for Discoverable Continual Corrections in Agentic RAG. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track, pages 3297–3307, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Iterate Until Retrieved: Factual Nugget Optimization for Discoverable Continual Corrections in Agentic RAG (Hazoom et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-industry.196.pdf