Yandex at WMT26: Translation Adaptation at 235B and Hard-Label Distillation to 8B

Dmitrii Popov, Elizaveta Kozlova, Ekaterina Taracheva, Elizaveta Makhotina, Artem Mekhraliev, Miron Baratelia, Ekaterina Enikeeva, Nikolay Karpachev


Abstract
We describe Yandex and Yandex-8B, our unconstrained and constrained submissions to the WMT26 General Machine Translation task. Our previous WMT25 submission, a 7B translation specialist, shows strong Fluency but comparatively weaker Accuracy. To combine its translation behavior with the capacity of a much larger model without replaying the full 7B training pipeline at 235B scale, we add two forms of supervision to the instruction-tuning data of an in-house 235B pretrained model: direct translation targets generated by the 7B specialist and in-house translation-related tasks. The resulting Yandex model improves both Accuracy and Fluency and reduces the LLM-based error score relative to the same 235B model tuned only on general instructions. Relative to the 7B specialist, it improves Accuracy and reduces the error score, while their Fluency point estimates remain similar. Yandex then provides hard targets for Yandex-8B, which is trained for English-to-Russian, English-to-Belarusian, English-to-Kazakh, and English-to-Armenian using direct and instruction-conditioned translation data. Across four directions, Yandex-8B obtains the highest paragraph-level ChrF++ and the highest Accuracy and Fluency under our LLM-based evaluation among five public baselines.
Anthology ID:
2026.wmt-main.77
Volume:
Proceedings of the Eleventh Conference on Machine Translation
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Barry Haddow, Tom Kocmi, Philipp Koehn, Christof Monz
Venues:
WMT | WS
SIG:
SIGMT
Publisher:
Association for Computational Linguistics
Note:
Pages:
1397–1404
Language:
URL:
https://aclanthology.org/2026.wmt-main.77/
DOI:
Bibkey:
Cite (ACL):
Dmitrii Popov, Elizaveta Kozlova, Ekaterina Taracheva, Elizaveta Makhotina, Artem Mekhraliev, Miron Baratelia, Ekaterina Enikeeva, and Nikolay Karpachev. 2026. Yandex at WMT26: Translation Adaptation at 235B and Hard-Label Distillation to 8B. In Proceedings of the Eleventh Conference on Machine Translation, pages 1397–1404, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Yandex at WMT26: Translation Adaptation at 235B and Hard-Label Distillation to 8B (Popov et al., WMT 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.wmt-main.77.pdf