Do Multilingual Neural Machine Translation Models Contain Language Pair Specific Attention Heads?

Zae Myung Kim, Laurent Besacier, Vassilina Nikoulina, Didier Schwab


Anthology ID:
2021.findings-acl.250
Volume:
Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021
Month:
August
Year:
2021
Address:
Online
Editors:
Chengqing Zong, Fei Xia, Wenjie Li, Roberto Navigli
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
2832–2841
Language:
URL:
https://aclanthology.org/2021.findings-acl.250
DOI:
10.18653/v1/2021.findings-acl.250
Bibkey:
Cite (ACL):
Zae Myung Kim, Laurent Besacier, Vassilina Nikoulina, and Didier Schwab. 2021. Do Multilingual Neural Machine Translation Models Contain Language Pair Specific Attention Heads?. In Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021, pages 2832–2841, Online. Association for Computational Linguistics.
Cite (Informal):
Do Multilingual Neural Machine Translation Models Contain Language Pair Specific Attention Heads? (Kim et al., Findings 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.findings-acl.250.pdf
Video:
 https://aclanthology.org/2021.findings-acl.250.mp4