I2R’s End-to-End Speech Translation System for IWSLT 2023 Offline Shared Task

Muhammad Huzaifah, Kye Min Tan, Richeng Duan


Abstract
This paper describes I2R’s submission to the offline speech translation track for IWSLT 2023. We focus on an end-to-end approach for translation from English audio to German text, one of the three available language directions in this year’s edition. The I2R system leverages on pretrained models that have been exposed to large-scale audio and text data for our base model. We introduce several stages of additional pretraining followed by fine-tuning to adapt the system for the downstream speech translation task. The strategy is supplemented by other techniques such as data augmentation, domain tagging, knowledge distillation, and model ensemble, among others. We evaluate the system on several publicly available test sets for comparison.
Anthology ID:
2023.iwslt-1.16
Volume:
Proceedings of the 20th International Conference on Spoken Language Translation (IWSLT 2023)
Month:
July
Year:
2023
Address:
Toronto, Canada (in-person and online)
Editors:
Elizabeth Salesky, Marcello Federico, Marine Carpuat
Venue:
IWSLT
SIG:
SIGSLT
Publisher:
Association for Computational Linguistics
Note:
Pages:
202–210
Language:
URL:
https://aclanthology.org/2023.iwslt-1.16
DOI:
10.18653/v1/2023.iwslt-1.16
Bibkey:
Cite (ACL):
Muhammad Huzaifah, Kye Min Tan, and Richeng Duan. 2023. I2R’s End-to-End Speech Translation System for IWSLT 2023 Offline Shared Task. In Proceedings of the 20th International Conference on Spoken Language Translation (IWSLT 2023), pages 202–210, Toronto, Canada (in-person and online). Association for Computational Linguistics.
Cite (Informal):
I2R’s End-to-End Speech Translation System for IWSLT 2023 Offline Shared Task (Huzaifah et al., IWSLT 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.iwslt-1.16.pdf