Varun Kotte

Author directory

2026

Query rewriting is now a common preprocessing step in retrieval-augmented generation (RAG) systems, yet it can silently damage grounding before generation begins: a fluent rewrite may drop the exact terms that retrieve the evidence. We study this retrieval-interface failure mode across five benchmarks, three retriever families, three rewriting strategies, and two open-weight LLMs. In the main Zephyr-7B setting, unconstrained rewriting degrades nDCG@10 by more than 0.05 for 26–76% of queries, with harmful cases often exhibiting evidence-anchor drift: rare domain terms, named entities, and numerics are replaced by less discriminative paraphrases. We propose a training-free constraint layer that identifies candidate evidence anchors, prompts the LLM to preserve them, verifies preservation deterministically, and falls back to the original query when verification fails. The method requires no retriever training, no logit access, and no constrained decoder. It reduces mean qrel-observed harm from 48% to 10% on BEIR and from 26% to 6% on Natural Questions, with the same qualitative pattern across tested retrievers, rewriting strategies, and 7B open-weight models. We isolate benchmark-labeled evidence exposure as a pre-generation condition for downstream attribution rather than evaluating generated answers. The results support a practical design principle: LLMs may expand retrieval queries, but the retrieval interface should explicitly protect the lexical anchors on which evidence access depends.