Ehime-U System for the WAT 2026 Patent Claims Evaluation Task: LLM-Based Translation Error Prediction Using Word Alignments

Wang Xu Yin, Isao Goto, Takashi Ninomiya


Abstract
This paper describes the Ehime-U system submitted to the Japanese–English Patent Claims Translation/Evaluation Task at WAT 2026. Our system predicts translation errors by providing an LLM with word-level correspondences between source and target claims. We compare six settings that differ in how these correspondences are obtained and whether they are used: four Unbalanced Optimal Transport (UOT)-based alignment methods (Forward, Reverse, AND, and OR), one alignment generated by LLM, and a baseline without alignment. We discuss how the choice of word correspondence affects error prediction. Against the gold reference annotations, under the hyperparameter settings used in this study, providing word correspondences improves error-detection F1 by up to 3.7 points over the no-alignment baseline (0.512 vs. 0.475). The improvement is category-specific: recall increases for alignment-dependent error categories but not for fluency errors. Comparing the two approaches to obtaining correspondences, we find that LLM-based alignment covers substantially more source tokens than the UOT alignments and achieves a higher F1 score than the best UOT setting under the hyperparameter settings used in this study (0.512 vs. 0.486).
Anthology ID:
2026.wat-1.9
Volume:
Proceedings of the Thirteenth Workshop on Asian Translation (WAT 2026)
Month:
November
Year:
2026
Address:
Hengqin, China
Editors:
Toshiaki Nakazawa, Isao Goto
Venues:
WAT | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
134–144
Language:
URL:
https://aclanthology.org/2026.wat-1.9/
DOI:
Bibkey:
Cite (ACL):
Wang Xu Yin, Isao Goto, and Takashi Ninomiya. 2026. Ehime-U System for the WAT 2026 Patent Claims Evaluation Task: LLM-Based Translation Error Prediction Using Word Alignments. In Proceedings of the Thirteenth Workshop on Asian Translation (WAT 2026), pages 134–144, Hengqin, China. Association for Computational Linguistics.
Cite (Informal):
Ehime-U System for the WAT 2026 Patent Claims Evaluation Task: LLM-Based Translation Error Prediction Using Word Alignments (Yin et al., WAT 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.wat-1.9.pdf