Unsupervised vocabulary selection for simultaneous lecture translation

Paul Maergner, Kevin Kilgour, Ian Lane, Alex Waibel


Abstract
In this work, we propose a novel method for vocabulary selection which enables simultaneous speech recognition systems for lectures to automatically adapt to the diverse topics that occur in educational and scientific lectures. Utilizing materials that are available before the lecture begins, such as lecture slides, our proposed framework iteratively searches for related documents on the World Wide Web and generates a lecture-specific vocabulary and language model based on the resulting documents. In this paper, we introduce a novel method for vocabulary selection where we rank vocabulary that occurs in the collected documents based on a relevance score which is calculated using a combination of word features. Vocabulary selection is a critical component for topic adaptation that has typically been overlooked in prior works. On the interACT German-English simultaneous lecture translation system our proposed approach significantly improved vocabulary coverage, reducing the out-of-vocabulary rate on average by 57.0% and up to 84.9%, compared to a lecture-independent baseline. Furthermore, our approach reduced the word error rate by up to 25.3% (on average 13.2% across all lectures), compared to a lectureindependent baseline.
Anthology ID:
2011.iwslt-papers.4
Volume:
Proceedings of the 8th International Workshop on Spoken Language Translation: Papers
Month:
December 8-9
Year:
2011
Address:
San Francisco, California
Editors:
Marcello Federico, Mei-Yuh Hwang, Margit Rödder, Sebastian Stüker
Venue:
IWSLT
SIG:
SIGSLT
Publisher:
Note:
Pages:
214–221
Language:
URL:
https://aclanthology.org/2011.iwslt-papers.4
DOI:
Bibkey:
Cite (ACL):
Paul Maergner, Kevin Kilgour, Ian Lane, and Alex Waibel. 2011. Unsupervised vocabulary selection for simultaneous lecture translation. In Proceedings of the 8th International Workshop on Spoken Language Translation: Papers, pages 214–221, San Francisco, California.
Cite (Informal):
Unsupervised vocabulary selection for simultaneous lecture translation (Maergner et al., IWSLT 2011)
Copy Citation:
PDF:
https://aclanthology.org/2011.iwslt-papers.4.pdf