Relay-MT: Multi-agent LLM Ensembling for Machine Translation – Samsung R&D Poland Submission for WMT2026

Adam Dobrowolski, Paweł Przybysz, Marcin Szymański, Paweł Przewłocki, Artur Janicki


Abstract
We propose a method to improve machine translation quality by ensembling multiple large language models within a multi-agent framework. The method addresses the problem of ensembling models with different tokenizations by abstracting away from token-level representations and operating at the level of generated text. The approach integrates several established concepts in MT, including ensembling, quality estimation, and reranking into one translation system. The log-likelihood reranking applied in this paper significantly improves results, even without ensembling. Experimental results show improvements comparable to COMET-MBR.
Anthology ID:
2026.wmt-main.64
Volume:
Proceedings of the Eleventh Conference on Machine Translation
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Barry Haddow, Tom Kocmi, Philipp Koehn, Christof Monz
Venues:
WMT | WS
SIG:
SIGMT
Publisher:
Association for Computational Linguistics
Note:
Pages:
1235–1247
Language:
URL:
https://aclanthology.org/2026.wmt-main.64/
DOI:
Bibkey:
Cite (ACL):
Adam Dobrowolski, Paweł Przybysz, Marcin Szymański, Paweł Przewłocki, and Artur Janicki. 2026. Relay-MT: Multi-agent LLM Ensembling for Machine Translation – Samsung R&D Poland Submission for WMT2026. In Proceedings of the Eleventh Conference on Machine Translation, pages 1235–1247, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Relay-MT: Multi-agent LLM Ensembling for Machine Translation – Samsung R&D Poland Submission for WMT2026 (Dobrowolski et al., WMT 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.wmt-main.64.pdf