EviNoteRAG: Enhancing RAG Models via Quality-Augmented Evidence Notes

Yuqin Dai, Guoqing Wang, Yuan Wang, Zhouheng Yao, Kairan Dou, Kaichen Zhou, Zhanwei Zhang, Shuo Yang, Fei Tang, Jun Yin, Pengyu Zeng, Can YI, Changhua Meng, Yuchen Zhou, Yongliang Shen, Shuai Lu


Abstract
Retrieval-Augmented Generation (RAG) has advanced open-domain question answering by incorporating external information into model reasoning. However, raw retrieved content often suffers from low signal-to-noise ratio, where answer-supportive information is diluted by irrelevant material, and error accumulation, where incomplete or misleading content degrades multi-hop reasoning. To address these challenges, we propose EviNoteRAG, a framework that enhances RAG through quality-augmented evidence notes. The model is trained to generate Supportive-Evidence Notes (SENs), concise abstractions that preserve only answer-critical information and explicitly highlight key and uncertain content to improve reasoning accuracy. To further ensure note quality, we introduce an entailment-based Evidence Quality Reward (EQR), which incentivizes SENs to be logically sufficient for deriving the correct answer. Experiments on both in-domain and out-of-domain benchmarks demonstrate that EviNoteRAG achieves state-of-the-art performance, with relative F1 gains of 20% on HotpotQA (+0.093), 40% on Bamboogle (+0.151), and 91% on 2Wiki (+0.256), while also improving training stability and efficiency.
Anthology ID:
2026.emnlp-main.2108
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
47970–47990
Language:
URL:
https://aclanthology.org/2026.emnlp-main.2108/
DOI:
Bibkey:
Cite (ACL):
Yuqin Dai, Guoqing Wang, Yuan Wang, Zhouheng Yao, Kairan Dou, Kaichen Zhou, Zhanwei Zhang, Shuo Yang, Fei Tang, Jun Yin, Pengyu Zeng, Can YI, Changhua Meng, Yuchen Zhou, Yongliang Shen, and Shuai Lu. 2026. EviNoteRAG: Enhancing RAG Models via Quality-Augmented Evidence Notes. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 47970–47990, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
EviNoteRAG: Enhancing RAG Models via Quality-Augmented Evidence Notes (Dai et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.2108.pdf