Beyond Epistemic Collapse: Disagreement-Aware Scientific Retrieval-Augmented Generation

Animesh Mishra, Krishang Sharma, Sonia Khetarpaul


Abstract
Scientific retrieval-augmented generation (RAG) systems typically return one fluent answer even when the underlying literature contains multiple well-supported but incompatible views. We call this failure mode epistemic collapse: compression of structured disagreement into a single response. We present EVIRAG (Evidence-centric, Viewpoint-Inclusive RAG), a framework for scientific question answering that combines adversarial retrieval, claim-level disagreement graphs, causal disagreement attribution, multi-view synthesis, and evidence structured confidence labels. We also introduce EVIRAG-BENCH, a 1,250-query benchmark spanning five contested scientific domains. Across eight compared systems, EVIRAG substantially outperforms vanilla RAG on ContradictionRecall and dense-encoder ViewpointCoverage while reducing Consensus Collapse Score. Human evaluation with three annotators confirms markedly higher epistemic completeness for EVIRAG than for vanilla RAG (Krippendorff’s α=0.72, p<0.001, Cohen’s d=2.71). An offline precomputed graph reduces warm-query latency by over an order of magnitude. These results suggest that treating disagreement preservation as a primary design objective substantially improves how scientific RAG systems represent contested evidence in disagreement-heavy QA settings.
Anthology ID:
2026.emnlp-main.2421
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
54964–54985
Language:
URL:
https://aclanthology.org/2026.emnlp-main.2421/
DOI:
Bibkey:
Cite (ACL):
Animesh Mishra, Krishang Sharma, and Sonia Khetarpaul. 2026. Beyond Epistemic Collapse: Disagreement-Aware Scientific Retrieval-Augmented Generation. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 54964–54985, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Beyond Epistemic Collapse: Disagreement-Aware Scientific Retrieval-Augmented Generation (Mishra et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.2421.pdf