Learning Optimal Policy for Simultaneous Machine Translation via Binary Search

Shoutao Guo, Shaolei Zhang, Yang Feng


Abstract
Simultaneous machine translation (SiMT) starts to output translation while reading the source sentence and needs a precise policy to decide when to output the generated translation. Therefore, the policy determines the number of source tokens read during the translation of each target token. However, it is difficult to learn a precise translation policy to achieve good latency-quality trade-offs, because there is no golden policy corresponding to parallel sentences as explicit supervision. In this paper, we present a new method for constructing the optimal policy online via binary search. By employing explicit supervision, our approach enables the SiMT model to learn the optimal policy, which can guide the model in completing the translation during inference. Experiments on four translation tasks show that our method can exceed strong baselines across all latency scenarios.
Anthology ID:
2023.acl-long.130
Volume:
Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Anna Rogers, Jordan Boyd-Graber, Naoaki Okazaki
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
2318–2333
Language:
URL:
https://aclanthology.org/2023.acl-long.130
DOI:
10.18653/v1/2023.acl-long.130
Bibkey:
Cite (ACL):
Shoutao Guo, Shaolei Zhang, and Yang Feng. 2023. Learning Optimal Policy for Simultaneous Machine Translation via Binary Search. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 2318–2333, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
Learning Optimal Policy for Simultaneous Machine Translation via Binary Search (Guo et al., ACL 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.acl-long.130.pdf
Video:
 https://aclanthology.org/2023.acl-long.130.mp4