Does Retrieval Augmented Generation Collapse When It Retrieves AI-Generated Documents?

Riddhimaan Senapati, Gregory Druck, Chang Zeng, Fabeha Fatima, Rati Rastogi, Ozel Yilmazel


Abstract
AI-generated text now constitutes a substantial and growing fraction of indexed web content, creating a feedback loop in which AI assistants may retrieve and condition on their own prior generations. Prior work shows that recursive training on model generations causes model collapse: a loss of output diversity and distributional drift. We ask whether a similar collapse emerges at inference time, when LLMs retrieve their own generations via RAG without any parameter updates. We measure collapse as the progressive convergence of responses to a narrow set across recursive retrieval rounds. Across three contamination simulations and four open-source LLMs, answer collapse is rapid and consistent under direct contamination, but slower, partial, and model-dependent under realistic competitive retrieval. Collapse can also degrade downstream accuracy on factual multi-hop QA, though the effect is inconsistent across models. We further show that the self-generated documents we introduce are cited far above their share of the retrieved context, an effect that is not fully explained by document quality, writing style, AI authorship, and self-preference. Finally, we propose and evaluate mitigation strategies at both the retrieval and generation stages, none of which reliably prevent collapse. As AI-generated content continues to populate the open web, collapse-resistant retrieval design becomes a prerequisite for trustworthy AI assistants.
Anthology ID:
2026.groundlm-1.45
Volume:
Proceedings of the 1st Workshop on Grounding Language Models: Learning Faithfully and Efficiently (GroundLM 2026)
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Yimu Wang, Yee Man Choi, Di Wu, Siqi Ouyang, Mozhgan Nasr Azadani, Yi R. (May) Fung
Venues:
GroundLM | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
578–605
Language:
URL:
https://aclanthology.org/2026.groundlm-1.45/
DOI:
Bibkey:
Cite (ACL):
Riddhimaan Senapati, Gregory Druck, Chang Zeng, Fabeha Fatima, Rati Rastogi, and Ozel Yilmazel. 2026. Does Retrieval Augmented Generation Collapse When It Retrieves AI-Generated Documents?. In Proceedings of the 1st Workshop on Grounding Language Models: Learning Faithfully and Efficiently (GroundLM 2026), pages 578–605, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Does Retrieval Augmented Generation Collapse When It Retrieves AI-Generated Documents? (Senapati et al., GroundLM 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.groundlm-1.45.pdf