FACET at WMT 2026 Automated Translation Quality Evaluation Task

Ahrii Kim, Chanjun Park, Seong-Heum Kim


Abstract
Different error types in machine translation require different evidence. Whether meaning is preserved can be judged only against the source, while whether the target is well-formed, or whether it names one entity consistently, can be judged from the target alone. We present FACET, our reference-free submission to the WMT26 Automated Translation Quality Evaluation Task, which decomposes evaluation into Fluency, Accuracy, and Consistency passes and gives each pass only the context its error type requires. A single fixed model is prompted three times, and the merged error spans yield the three task outputs, error spans, quality scores, and error-free labels, with no trained components. We also submit FACET−C, which omits the Consistency pass. Without gold labels, we characterize the predictions of FACET. Its system rankings place post-edited human translation first, and the Consistency pass changes about a tenth of segment scores while leaving the ranking nearly unchanged.
Anthology ID:
2026.wmt-main.100
Volume:
Proceedings of the Eleventh Conference on Machine Translation
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Barry Haddow, Tom Kocmi, Philipp Koehn, Christof Monz
Venues:
WMT | WS
SIG:
SIGMT
Publisher:
Association for Computational Linguistics
Note:
Pages:
1667–1677
Language:
URL:
https://aclanthology.org/2026.wmt-main.100/
DOI:
Bibkey:
Cite (ACL):
Ahrii Kim, Chanjun Park, and Seong-Heum Kim. 2026. FACET at WMT 2026 Automated Translation Quality Evaluation Task. In Proceedings of the Eleventh Conference on Machine Translation, pages 1667–1677, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
FACET at WMT 2026 Automated Translation Quality Evaluation Task (Kim et al., WMT 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.wmt-main.100.pdf