ParaRater: Enhancing Cross-Lingual Transfer in LLMs with Meta-Learning

Wenhan Han, Binbin Liu, Zhixun Chen, Yifan Zhang, Mykola Pechenizkiy, Meng Fang, Yin Zheng


Abstract
Multilingual LLMs increasingly claim broad language coverage, yet their performance still lags far behind English in many languages. Because low resource data is scarce and noisy, improving these languages directly is difficult, making cross lingual transfer from English a natural alternative. Parallel corpora are central to such transfer, but it remains unclear which kinds of parallel data matter most. We propose ParaRater, a corpus selection method that identifies high value English text to translate into target languages, building parallel corpora that most efficiently improve target language performance. ParaRater uses meta learning to tie selection directly to downstream accuracy on native target language data, and applies a two stage filter to find samples that only help when both language versions are used in training, capturing truly impactful parallel data. Experiments across Chinese, German, French, Japanese, Thai, Arabic, Tagalog, and Russian, together with qualitative analyses, support these findings.
Anthology ID:
2026.emnlp-main.1760
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
40131–40144
Language:
URL:
https://aclanthology.org/2026.emnlp-main.1760/
DOI:
Bibkey:
Cite (ACL):
Wenhan Han, Binbin Liu, Zhixun Chen, Yifan Zhang, Mykola Pechenizkiy, Meng Fang, and Yin Zheng. 2026. ParaRater: Enhancing Cross-Lingual Transfer in LLMs with Meta-Learning. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 40131–40144, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
ParaRater: Enhancing Cross-Lingual Transfer in LLMs with Meta-Learning (Han et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.1760.pdf