Sanjeeb Prasad Panday

Author directory

2026

Retrieval-augmented generation assumes that language models can use relevant context while rejecting semantically related but non-evidential context. Further, multilingual retrieval adds a second assumption that when evidence appears in different languages, models arbitrate by factual content instead of language cues. We test both these assumptions as generator-side failures to understand how models bind, compare, and trust evidence across languages. We first study near-miss contamination where we add true, relation-matched context about a nearby entity that does not answer the target question. Across Mintaka and PopQA, this context raises distractor adoption before any direct contradiction is introduced, and the effect persists across every tested model and language.

We then study language evidence arbitration where English and local-language evidence disagree. We find that language preference is model-family dependent. GPT-5.4-mini leans toward English across all four languages, while DeepSeek models lean toward local-language evidence for all tested languages. We also run a label-only control where both snippets are written in English and only the source label varies and find that evidence labeled as English is over-trusted, with 95% bootstrap confidence intervals excluding zero across all 16 model-language pairs. Our results thus show that context use is shaped by entity proximity, language preference, and source-language metadata.