Leaving the English Basin: A Logit-Lens View of Cross-Lingual Emotion Transfer in Multilingual LLMs

Zarina Uvalieva


Abstract
We study how multilingual LLMs encode emotion in English, Russian, and Kyrgyz - a low-resource Turkic language absent from prior emotion-probing work - on a parallel corpus of 1,480 sentences with six Ekman labels mapped from GoEmotions. Across four decoder LLMs (Gemma 4, Qwen3, Llama-3.1, Mistral), an encoder baseline (XLM-R), and an expanded 8-model sample, we combine layer-wise probing, similarity metrics (CKA, Procrustes, RSA), leakage-free cross-lingual transfer, and a null-calibrated sentence-level logit lens. Three findings. (1) What separates languages in the "latent-English" pivot (Wendler et al., 2024) is not the mid-network English level — which a shuffled-representation null reproduces - but the depth of the exit from the English basin: on pooled sentence representations Kyrgyz exits only in the last third of every applicable decoder (d_.5 ≈ .97/.86/.97) and never earlier than Russian (.97/.64/.75; under a last-token lens both languages tie late, .92–.97) - a lossier pivot, consistent with its larger transfer gap. (2) Similarity and transfer dissociate: Mistral has the highest RU–KY CKA (.800) yet the lowest KY transfer (.239), so CKA is an unreliable proxy for cross-lingual generalization. (3) Encoder/decoder architecture does not order Kyrgyz transfer: XLM-R leads (.384) but mBERT is second-to-last (.198). XLM-R’s edge is not significant on absolute KY (p=.081); it concentrates in the into-Kyrgyz directions (interaction p<.01 vs. Qwen3) and reaches significance only under a secondary chance-corrected metric - consistent with pre-training data scale and domain rather than architecture (an interpretation, not a ranking predictor). All 8 models beat chance in every language.
Anthology ID:
2026.mrl-1.7
Volume:
Proceedings of the 6th Workshop on Multilingual Representation Learning (MRL 2026)
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
David Ifeoluwa Adelani, Jesujoba Alabi, Catherine Arnett, Tyler Chang, C.M. Downey, Omer Goldman, Senyu Li, Lester James Validad Miranda, Jirui Qi, David Stap, Genta Indra Winata, Xinyu Crystina Zhang
Venues:
MRL | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
68–90
Language:
URL:
https://aclanthology.org/2026.mrl-1.7/
DOI:
Bibkey:
Cite (ACL):
Zarina Uvalieva. 2026. Leaving the English Basin: A Logit-Lens View of Cross-Lingual Emotion Transfer in Multilingual LLMs. In Proceedings of the 6th Workshop on Multilingual Representation Learning (MRL 2026), pages 68–90, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Leaving the English Basin: A Logit-Lens View of Cross-Lingual Emotion Transfer in Multilingual LLMs (Uvalieva, MRL 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.mrl-1.7.pdf