Reasoning Beyond English: Separating Capability and Language in Cross-Lingual Reasoning Model Adaptation

Jan Eliasz, Mikołaj Langner, Dzmitry Pihulski, Konrad Wojtasik, Przemyslaw Kazienko, Jan Kocon, Teddy Ferdinan


Abstract
Many top-performing reasoning language models (RLMs) exhibit English-centric reasoning behavior, generating English chains of thought even when the prompt and final answer are in another language. Beyond its impact on multilingual reasoning performance, this also blocks downstream uses of the reasoning trace, such as debugging model errors and auditing decisions. We studied different approaches to RLM language adaptation by adapting Qwen3-4B-Thinking-2507 into Polish. We find that the accuracy collapse of SFT decomposes additively into termination and quality failure modes. On the other hand, KL-anchored fine-tuning mitigates these failures but exhibits a sharp plateau-then-cliff structure under reverse divergence: language match collapses from 0.89 to 0.37 as 𝛼 doubles, with no comparable structure under forward divergence. However, a second training stage leveraging GRPO helps close the remaining gap and recover the language match even from configurations past the cliff, revealing that the two stages divide labor: the supervised stage controls reasoning quality while the RL stage closes residual language match gaps. These findings suggest that, in a two-stage RLM post-training, the supervised phase can be considerably less constrained than current practice assumes.
Anthology ID:
2026.emnlp-main.2481
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
56324–56344
Language:
URL:
https://aclanthology.org/2026.emnlp-main.2481/
DOI:
Bibkey:
Cite (ACL):
Jan Eliasz, Mikołaj Langner, Dzmitry Pihulski, Konrad Wojtasik, Przemyslaw Kazienko, Jan Kocon, and Teddy Ferdinan. 2026. Reasoning Beyond English: Separating Capability and Language in Cross-Lingual Reasoning Model Adaptation. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 56324–56344, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Reasoning Beyond English: Separating Capability and Language in Cross-Lingual Reasoning Model Adaptation (Eliasz et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.2481.pdf