Near-Miss Context Contamination and Language-Asymmetric Evidence Arbitration in LLMs

Jebish Purbey, Sanjeeb Prasad Panday, Barnnita Shrestha, Bikash Balami, Aakash Pandey, Bibek Khanal


Abstract
Retrieval-augmented generation assumes that language models can use relevant context while rejecting semantically related but non-evidential context. Further, multilingual retrieval adds a second assumption that when evidence appears in different languages, models arbitrate by factual content instead of language cues. We test both these assumptions as generator-side failures to understand how models bind, compare, and trust evidence across languages. We first study near-miss contamination where we add true, relation-matched context about a nearby entity that does not answer the target question. Across Mintaka and PopQA, this context raises distractor adoption before any direct contradiction is introduced, and the effect persists across every tested model and language.

We then study language evidence arbitration where English and local-language evidence disagree. We find that language preference is model-family dependent. GPT-5.4-mini leans toward English across all four languages, while DeepSeek models lean toward local-language evidence for all tested languages. We also run a label-only control where both snippets are written in English and only the source label varies and find that evidence labeled as English is over-trusted, with 95% bootstrap confidence intervals excluding zero across all 16 model-language pairs. Our results thus show that context use is shaped by entity proximity, language preference, and source-language metadata.
Anthology ID:
2026.emnlp-main.2392
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
54388–54404
Language:
URL:
https://aclanthology.org/2026.emnlp-main.2392/
DOI:
Bibkey:
Cite (ACL):
Jebish Purbey, Sanjeeb Prasad Panday, Barnnita Shrestha, Bikash Balami, Aakash Pandey, and Bibek Khanal. 2026. Near-Miss Context Contamination and Language-Asymmetric Evidence Arbitration in LLMs. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 54388–54404, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Near-Miss Context Contamination and Language-Asymmetric Evidence Arbitration in LLMs (Purbey et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.2392.pdf