ReMova: Fine-tuning LLMs for English to Belarusian translation

Mikita Pilinka, Aliaksandr Kliuyeu, David Samuel, Yves Scherrer


Abstract
This paper presents a Belarusian-specific data-cleaning pipeline and fine-tuning for English-Belarusian machine translation. Our cleaning pipeline distinguishes itself from others by employing a correction tool that addresses the issue of the two orthographies of the Belarusian language, noise in the training data, interference from other languages, and other misspelling issues common in Belarusian on the internet. A matched ablation on unfiltered training data shows substantial benefits from filtering for all fine-tuned models, with the LLM-based models gaining roughly twice as much from filtering as the dedicated encoder-decoder MT system, supporting the view that for Belarusian MT one of the primary bottlenecks is data quality.
Anthology ID:
2026.wmt-main.75
Volume:
Proceedings of the Eleventh Conference on Machine Translation
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Barry Haddow, Tom Kocmi, Philipp Koehn, Christof Monz
Venues:
WMT | WS
SIG:
SIGMT
Publisher:
Association for Computational Linguistics
Note:
Pages:
1378–1390
Language:
URL:
https://aclanthology.org/2026.wmt-main.75/
DOI:
Bibkey:
Cite (ACL):
Mikita Pilinka, Aliaksandr Kliuyeu, David Samuel, and Yves Scherrer. 2026. ReMova: Fine-tuning LLMs for English to Belarusian translation. In Proceedings of the Eleventh Conference on Machine Translation, pages 1378–1390, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
ReMova: Fine-tuning LLMs for English to Belarusian translation (Pilinka et al., WMT 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.wmt-main.75.pdf