Rational Synthesizers or Heuristic Followers? Analyzing LLMs in RAG-based Question-Answering

Atharv Naphade


Abstract
Retrieval-Augmented Generation (RAG) is the prevailing paradigm for grounding Large Language Models (LLMs), yet the mechanisms governing how models integrate groups of conflicting retrieved evidence remain opaque. Does an LLM answer a certain way because the evidence is factually strong, because of a prior belief, or merely because it is repeated frequently? To answer this, we introduce GroupQA, a curated dataset of 1,635 controversial questions paired with 15,058 diversely-sourced evidence documents, annotated for stance and qualitative strength. Through controlled experiments, we characterize group-level evidence aggregation dynamics: Paraphrasing an argument can be more persuasive than providing distinct independent support; Models favor evidence presented first rather than last, and Larger models are increasingly resistant to adapt to presented evidence. Additionally, we find that LLM explanations to group-based answers are unfaithful. Together, we show that LLMs behave consistently as vulnerable heuristic followers, with direct implications for improving RAG system design.
Anthology ID:
2026.findings-acl.2003
Volume:
Findings of the Association for Computational Linguistics: ACL 2026
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
40293–40311
Language:
URL:
https://aclanthology.org/2026.findings-acl.2003/
DOI:
10.18653/v1/2026.findings-acl.2003
Bibkey:
Cite (ACL):
Atharv Naphade. 2026. Rational Synthesizers or Heuristic Followers? Analyzing LLMs in RAG-based Question-Answering. In Findings of the Association for Computational Linguistics: ACL 2026, pages 40293–40311, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
Rational Synthesizers or Heuristic Followers? Analyzing LLMs in RAG-based Question-Answering (Naphade, Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-acl.2003.pdf
Checklist:
 2026.findings-acl.2003.checklist.pdf