Adding ciofs and ciüfs to BOUQuET: Benchmark Extension to Ladin

Samuel Frontull, Lara Castlunger, Maximilian Oberhollenzer, Karin Comploj, Ruth Videsott, Robert Sama, Gabriel Perathoner, Carlo Zoli, Paul Videsott


Abstract
Benchmarks do more than report scores: they provide a shared basis for evaluating methods, comparing systems, and measuring progress. As language technologies are now widely integrated into everyday life, efforts should also be made to include minority languages in the resources that underpin language-technology development. If languages are absent from relevant benchmarks, they remain harder to evaluate, compare, and incorporate into future language technologies. Expanding benchmark coverage is therefore essential for ensuring fair evaluation, increasing visibility, and enabling continued development of language technologies for these communities. To support MT development for Ladin, we contribute a Ladin extension of BOUQuET to the WMT 2026 OLDI shared task, covering the Val Badia and Gherdëina varieties. We present a systematic reference-creation workflow combining human translation, expert revision, cross-variant alignment, and blind ranking to produce high-quality references. The dataset is released under the CC BY-SA 4.0 license.
Anthology ID:
2026.wmt-main.194
Volume:
Proceedings of the Eleventh Conference on Machine Translation
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Barry Haddow, Tom Kocmi, Philipp Koehn, Christof Monz
Venues:
WMT | WS
SIG:
SIGMT
Publisher:
Association for Computational Linguistics
Note:
Pages:
2493–2504
Language:
URL:
https://aclanthology.org/2026.wmt-main.194/
DOI:
Bibkey:
Cite (ACL):
Samuel Frontull, Lara Castlunger, Maximilian Oberhollenzer, Karin Comploj, Ruth Videsott, Robert Sama, Gabriel Perathoner, Carlo Zoli, and Paul Videsott. 2026. Adding ciofs and ciüfs to BOUQuET: Benchmark Extension to Ladin. In Proceedings of the Eleventh Conference on Machine Translation, pages 2493–2504, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Adding ciofs and ciüfs to BOUQuET: Benchmark Extension to Ladin (Frontull et al., WMT 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.wmt-main.194.pdf