SHIFT: Semantic Harmonization via Index-side Feature Transformation for Multilingual Information Retrieval

Youngjoon Jang, Seongtae Hong, Hyeonseok Moon, Heuiseok Lim


Abstract
With the rapid expansion of massive multilingual corpora, Multilingual Information Retrieval (MLIR) has emerged as a critical technology for global information access. MLIR enables users to retrieve semantically relevant documents from multilingual text collections using a single-language query. However, recent multilingual dense retrieval models often exhibit a strong preference for documents in the same language as the query. This leads to severe language bias, where top-ranked results are dominated by documents of specific languages, even when documents in other languages contain more semantically relevant information. To address this issue, we propose Shift, a training-free method applicable in the indexing stage. Specifically, Shift utilizes parallel translation pairs to estimate a relative language vector for each target language with respect to a source language. Subsequently, Shift corrects the language-specific offset by subtracting this relative language vector from document embeddings during indexing. Our comprehensive evaluation across four MLIR benchmarks and diverse dense retrieval models confirms that Shift can effectively mitigate language bias and enhance MLIR performance.
Anthology ID:
2026.findings-emnlp.109
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
2247–2269
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.109/
DOI:
Bibkey:
Cite (ACL):
Youngjoon Jang, Seongtae Hong, Hyeonseok Moon, and Heuiseok Lim. 2026. SHIFT: Semantic Harmonization via Index-side Feature Transformation for Multilingual Information Retrieval. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 2247–2269, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
SHIFT: Semantic Harmonization via Index-side Feature Transformation for Multilingual Information Retrieval (Jang et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.109.pdf