Preserving Evidence Anchors: Query-Rewriting Guardrails for Retrieval-Side Grounding

Varun Kotte, Chirag Arora


Abstract
Query rewriting is now a common preprocessing step in retrieval-augmented generation (RAG) systems, yet it can silently damage grounding before generation begins: a fluent rewrite may drop the exact terms that retrieve the evidence. We study this retrieval-interface failure mode across five benchmarks, three retriever families, three rewriting strategies, and two open-weight LLMs. In the main Zephyr-7B setting, unconstrained rewriting degrades nDCG@10 by more than 0.05 for 26–76% of queries, with harmful cases often exhibiting evidence-anchor drift: rare domain terms, named entities, and numerics are replaced by less discriminative paraphrases. We propose a training-free constraint layer that identifies candidate evidence anchors, prompts the LLM to preserve them, verifies preservation deterministically, and falls back to the original query when verification fails. The method requires no retriever training, no logit access, and no constrained decoder. It reduces mean qrel-observed harm from 48% to 10% on BEIR and from 26% to 6% on Natural Questions, with the same qualitative pattern across tested retrievers, rewriting strategies, and 7B open-weight models. We isolate benchmark-labeled evidence exposure as a pre-generation condition for downstream attribution rather than evaluating generated answers. The results support a practical design principle: LLMs may expand retrieval queries, but the retrieval interface should explicitly protect the lexical anchors on which evidence access depends.
Anthology ID:
2026.groundlm-1.62
Volume:
Proceedings of the 1st Workshop on Grounding Language Models: Learning Faithfully and Efficiently (GroundLM 2026)
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Yimu Wang, Yee Man Choi, Di Wu, Siqi Ouyang, Mozhgan Nasr Azadani, Yi R. (May) Fung
Venues:
GroundLM | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
857–868
Language:
URL:
https://aclanthology.org/2026.groundlm-1.62/
DOI:
Bibkey:
Cite (ACL):
Varun Kotte and Chirag Arora. 2026. Preserving Evidence Anchors: Query-Rewriting Guardrails for Retrieval-Side Grounding. In Proceedings of the 1st Workshop on Grounding Language Models: Learning Faithfully and Efficiently (GroundLM 2026), pages 857–868, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Preserving Evidence Anchors: Query-Rewriting Guardrails for Retrieval-Side Grounding (Kotte & Arora, GroundLM 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.groundlm-1.62.pdf
Attachment:
 2026.groundlm-1.62.attachment.zip