Cross Attention Augmented Transducer Networks for Simultaneous Translation

Dan Liu, Mengge Du, Xiaoxi Li, Ya Li, Enhong Chen


Abstract
This paper proposes a novel architecture, Cross Attention Augmented Transducer (CAAT), for simultaneous translation. The framework aims to jointly optimize the policy and translation models. To effectively consider all possible READ-WRITE simultaneous translation action paths, we adapt the online automatic speech recognition (ASR) model, RNN-T, but remove the strong monotonic constraint, which is critical for the translation task to consider reordering. To make CAAT work, we introduce a novel latency loss whose expectation can be optimized by a forward-backward algorithm. We implement CAAT with Transformer while the general CAAT architecture can also be implemented with other attention-based encoder-decoder frameworks. Experiments on both speech-to-text (S2T) and text-to-text (T2T) simultaneous translation tasks show that CAAT achieves significantly better latency-quality trade-offs compared to the state-of-the-art simultaneous translation approaches.
Anthology ID:
2021.emnlp-main.4
Volume:
Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing
Month:
November
Year:
2021
Address:
Online and Punta Cana, Dominican Republic
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
39–55
Language:
URL:
https://aclanthology.org/2021.emnlp-main.4
DOI:
10.18653/v1/2021.emnlp-main.4
Bibkey:
Cite (ACL):
Dan Liu, Mengge Du, Xiaoxi Li, Ya Li, and Enhong Chen. 2021. Cross Attention Augmented Transducer Networks for Simultaneous Translation. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pages 39–55, Online and Punta Cana, Dominican Republic. Association for Computational Linguistics.
Cite (Informal):
Cross Attention Augmented Transducer Networks for Simultaneous Translation (Liu et al., EMNLP 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.emnlp-main.4.pdf
Video:
 https://aclanthology.org/2021.emnlp-main.4.mp4
Code
 danliu2/caat