The University of Melbourne WMT 2026 CreoleMT Submission: A Domain-Balanced Approach to Low-Resource Pacific Creole Machine Translation

Raphael Merx, Nick Thieberger, Ekaterina Vylomova


Abstract
For our submission to the WMT26 Creole Language Translation Shared Task, we focus on MT models for Pacific creoles: Tok Pisin, Bislama, and Solomon Pijin, with particular attention to broad domain performance. After pre-training on a large mix of domain-imbalanced data, we continue fine-tuning on a diverse mix of domain-balanced data. We rely on a number of data collection and preparation techniques, including LLM-assisted respelling and alignment, back-translation, and distillation from Gemini for domains originally not present in training data. Evaluated on Bouquet and a novel test set made of spoken transcripts, our models beat open model baselines by 3+ chrF++ points in all directions with human-original references. Looking ahead, we plan to develop human-translated test sets for Solomon Pijin and Bislama, and to distil our best models into much smaller ones that retain broad domain coverage.
Anthology ID:
2026.wmt-main.189
Volume:
Proceedings of the Eleventh Conference on Machine Translation
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Barry Haddow, Tom Kocmi, Philipp Koehn, Christof Monz
Venues:
WMT | WS
SIG:
SIGMT
Publisher:
Association for Computational Linguistics
Note:
Pages:
2455–2462
Language:
URL:
https://aclanthology.org/2026.wmt-main.189/
DOI:
Bibkey:
Cite (ACL):
Raphael Merx, Nick Thieberger, and Ekaterina Vylomova. 2026. The University of Melbourne WMT 2026 CreoleMT Submission: A Domain-Balanced Approach to Low-Resource Pacific Creole Machine Translation. In Proceedings of the Eleventh Conference on Machine Translation, pages 2455–2462, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
The University of Melbourne WMT 2026 CreoleMT Submission: A Domain-Balanced Approach to Low-Resource Pacific Creole Machine Translation (Merx et al., WMT 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.wmt-main.189.pdf