Predict and Fix: A Unified Model for Translation Quality Estimation and Post-Editing

Maciej Modrzejewski, Yash Bhaskar, Chinmay Pateria


Abstract
We propose a unified architecture for jointly modeling Translation Quality Estimation (QE) and Automatic Post-Editing (APE) within a single lightweight language model. Our approach integrates quality prediction and correction generation in a single decoding process using a decoder-only Qwen2.5 model (0.5B parameters), augmented with a dedicated QE regression head operating on hidden states at a special token position. The model produces structured outputs that include a continuous quality score, an edit decision, and a corrected translation when necessary. We train on datasets of 100K, 1M, and 1.84M manually annotated samples across eight language pairs, enabling analysis of both data scale and distribution. Experimental results show that the proposed model achieves strong QE performance (r=0.907) and high post-editing decision accuracy (88.4%), while reducing over-editing compared to both autoregressive baselines and large commercial LLMs.
Anthology ID:
2026.amta-research.5
Volume:
Proceedings of the 17th Conference of the Association for Machine Translation in the Americas (Volume 1: Research Track)
Month:
August
Year:
2026
Address:
Québec City, Canada
Editors:
Eleftheria Briakou, Jeremy Gwinnup, Shivali Goel
Venue:
AMTA
SIG:
Publisher:
Association for Machine Translation in the Americas
Note:
Pages:
80–89
Language:
URL:
https://aclanthology.org/2026.amta-research.5/
DOI:
Bibkey:
Cite (ACL):
Maciej Modrzejewski, Yash Bhaskar, and Chinmay Pateria. 2026. Predict and Fix: A Unified Model for Translation Quality Estimation and Post-Editing. In Proceedings of the 17th Conference of the Association for Machine Translation in the Americas (Volume 1: Research Track), pages 80–89, Québec City, Canada. Association for Machine Translation in the Americas.
Cite (Informal):
Predict and Fix: A Unified Model for Translation Quality Estimation and Post-Editing (Modrzejewski et al., AMTA 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.amta-research.5.pdf