Cross-Lingual Exploration for Parametric Knowledge

Elisha Diskind, Itamar Trainin, Uri Shaham, Leshem Choshen, Idan Szpektor, Omri Abend


Abstract
Parametric knowledge in Large Language Models is not equally accessible across languages. As a result, standard inference techniques often struggle to surface localized facts, leading to failures in cross-lingual knowledge transfer and consistency. In this work, we investigate techniques for accessing hidden factual knowledge by exploring the prompted questions across languages. We identify four inherent dimensions of cross-lingual exploration that directly govern parametric knowledge retrieval and evaluate them on multilingual factual benchmarks covering 17 typologically diverse languages. Our results demonstrate that cross-lingual exploration significantly improves knowledge transfer and factual recall, representing a more efficient compute Pareto frontier than native-language scaling. Furthermore, we report similar performance improvement in cross-lingual consistency, exceeding what can be explained by accuracy gains alone. Overall, our work demonstrates the potential of multilingual exploration to improve parametric knowledge recall.
Anthology ID:
2026.findings-emnlp.2443
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
52429–52466
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.2443/
DOI:
Bibkey:
Cite (ACL):
Elisha Diskind, Itamar Trainin, Uri Shaham, Leshem Choshen, Idan Szpektor, and Omri Abend. 2026. Cross-Lingual Exploration for Parametric Knowledge. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 52429–52466, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Cross-Lingual Exploration for Parametric Knowledge (Diskind et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.2443.pdf