A Multi-task Learning Framework for Quality Estimation

Sourabh Deoghare, Paramveer Choudhary, Diptesh Kanojia, Tharindu Ranasinghe, Pushpak Bhattacharyya, Constantin Orăsan


Abstract
Quality Estimation (QE) is the task of evaluating machine translation output in the absence of reference translation. Conventional approaches to QE involve training separate models at different levels of granularity viz., word-level, sentence-level, and document-level, which sometimes lead to inconsistent predictions for the same input. To overcome this limitation, we focus on jointly training a single model for sentence-level and word-level QE tasks in a multi-task learning framework. Using two multi-task learning-based QE approaches, we show that multi-task learning improves the performance of both tasks. We evaluate these approaches by performing experiments in different settings, viz., single-pair, multi-pair, and zero-shot. We compare the multi-task learning-based approach with baseline QE models trained on single tasks and observe an improvement of up to 4.28% in Pearson’s correlation (r) at sentence-level and 8.46% in F1-score at word-level, in the single-pair setting. In the multi-pair setting, we observe improvements of up to 3.04% at sentence-level and 13.74% at word-level; while in the zero-shot setting, we also observe improvements of up to 5.26% and 3.05%, respectively. We make the models proposed in this paper publically available.
Anthology ID:
2023.findings-acl.585
Volume:
Findings of the Association for Computational Linguistics: ACL 2023
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Anna Rogers, Jordan Boyd-Graber, Naoaki Okazaki
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
9191–9205
Language:
URL:
https://aclanthology.org/2023.findings-acl.585
DOI:
10.18653/v1/2023.findings-acl.585
Bibkey:
Cite (ACL):
Sourabh Deoghare, Paramveer Choudhary, Diptesh Kanojia, Tharindu Ranasinghe, Pushpak Bhattacharyya, and Constantin Orăsan. 2023. A Multi-task Learning Framework for Quality Estimation. In Findings of the Association for Computational Linguistics: ACL 2023, pages 9191–9205, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
A Multi-task Learning Framework for Quality Estimation (Deoghare et al., Findings 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.findings-acl.585.pdf
Video:
 https://aclanthology.org/2023.findings-acl.585.mp4