CycleIE: Robust Document Information Extraction through Iterative Verification and Refinement

Zhengxuan Zhang, Yin WU, Zhuowen Liang, Haixun Wang, Yuyu Luo, Nan Tang


Abstract
In document AI, reliable analytics require converting long, noisy (often multi-document) corpora into heterogeneous structured data—e.g., tables for numerical fields, graphs for relations, and trees for hierarchies. Yet, one-pass LLM extraction often yields incomplete or inconsistent structures because it lacks explicit verification and opportunities to revise earlier choices. We present CycleIE, an iterative information extraction (IE) framework that closes the loop between reasoning and acting by coupling ReAct with Monte Carlo Tree Search (MCTS). CycleIE employs a multi-agent workflow to iteratively retrieve, structure, extract, and refine content under verification guidance. By treating extraction as a feedback-driven search process, CycleIE systematically corrects omissions and inconsistencies that defeat one-pass methods, while remaining orthogonal to retrieval-augmented generation (RAG). Experiments on challenging document-based QA benchmarks demonstrate that CycleIE delivers >10% relative improvements over strong baselines, particularly in lengthy or multi-document contexts.
Anthology ID:
2026.findings-emnlp.418
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
8813–8829
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.418/
DOI:
Bibkey:
Cite (ACL):
Zhengxuan Zhang, Yin WU, Zhuowen Liang, Haixun Wang, Yuyu Luo, and Nan Tang. 2026. CycleIE: Robust Document Information Extraction through Iterative Verification and Refinement. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 8813–8829, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
CycleIE: Robust Document Information Extraction through Iterative Verification and Refinement (Zhang et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.418.pdf