What a DRAG (it is being small): The AMI Submission to the WMT 2026 General Translation Shared Task

Steinthór Steingrímsson, Sveinbjörn Thórdharson, Jón Dadason


Abstract
We describe the AMI team’s submission to the WMT 2026 General Translation shared task, participating in the English-Icelandic translation direction. Building on our 2025 submission, which relied on a 3B-parameter model and substantial rule-based post-processing, this year we aim to reduce that dependency and rely more on the translation model itself. We continually pre-train a Qwen3-4B checkpoint on a mixture of Icelandic, English, code, math, and structured data, then fine-tune it with LoRA on a retrieval-augmented, domain-conditioned instruction-tuning dataset covering five domains. At both training and inference time, source sentences are enriched with dictionary entries and back-translated example translations similar to the sentence being translated, retrieved by a dedicated RAG server, and served through a self-healing inference client that retries and validates generations. We report COMET and chrF++ scores comparing this system against last year’s submission, a larger Llama-3.1-8B model adapted with the same recipe, and an instruction-tuned Qwen3-4B baseline, alongside ablations that isolate the contribution of each part of the retrieval-augmented prompt.
Anthology ID:
2026.wmt-main.79
Volume:
Proceedings of the Eleventh Conference on Machine Translation
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Barry Haddow, Tom Kocmi, Philipp Koehn, Christof Monz
Venues:
WMT | WS
SIG:
SIGMT
Publisher:
Association for Computational Linguistics
Note:
Pages:
1414–1424
Language:
URL:
https://aclanthology.org/2026.wmt-main.79/
DOI:
Bibkey:
Cite (ACL):
Steinthór Steingrímsson, Sveinbjörn Thórdharson, and Jón Dadason. 2026. What a DRAG (it is being small): The AMI Submission to the WMT 2026 General Translation Shared Task. In Proceedings of the Eleventh Conference on Machine Translation, pages 1414–1424, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
What a DRAG (it is being small): The AMI Submission to the WMT 2026 General Translation Shared Task (Steingrímsson et al., WMT 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.wmt-main.79.pdf