CUNI-UFAL at WMT26 Multilingual Instruction Shared Task

Aleš Manuel Papáček, Patricia Schmidtova


Abstract
We describe our submission to the WMT26 Multilingual Instruction Shared Task, which evaluates sub-10B-parameter models on multilingual question answering, open-ended generation, and cross-lingual summarization. We compare four open-weight models and vary the system prompt, reasoning mode, and decoding parameters. On our development set, the tested prompt and reasoning changes have a larger effect on LLM-judge scores than the difference between the two finalist models in their best settings. Gemma 4 E4B obtains the highest overall judge score, whereas Qwen 3.5 9B follows hard constraints more reliably on our internal benchmark. We therefore submit Qwen as our primary system and Gemma as a secondary system. We also introduce a 1,283-example diagnostic benchmark for grounded QA, constrained generation, and abstract writing from ACL papers in 24 languages. Using it for QLoRA fine-tuning does not work in our setup, it lowers validation loss but does not improve quality under our LLM judge. In the official automatic evaluation, our Gemma system ranks first overall and our Qwen system second; Qwen wins QA-context, while Gemma wins QA-OEG and places second in summarization.
Anthology ID:
2026.wmt-main.130
Volume:
Proceedings of the Eleventh Conference on Machine Translation
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Barry Haddow, Tom Kocmi, Philipp Koehn, Christof Monz
Venues:
WMT | WS
SIG:
SIGMT
Publisher:
Association for Computational Linguistics
Note:
Pages:
1949–1958
Language:
URL:
https://aclanthology.org/2026.wmt-main.130/
DOI:
Bibkey:
Cite (ACL):
Aleš Manuel Papáček and Patricia Schmidtova. 2026. CUNI-UFAL at WMT26 Multilingual Instruction Shared Task. In Proceedings of the Eleventh Conference on Machine Translation, pages 1949–1958, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
CUNI-UFAL at WMT26 Multilingual Instruction Shared Task (Papáček & Schmidtova, WMT 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.wmt-main.130.pdf