Enlivening Redundant Heads in Multi-head Self-attention for Machine Translation

Enlivening Redundant Heads in Multi-head Self-attention for Machine Translation Tianfu Zhang author Heyan Huang author Chong Feng author Longbing Cao author 2021-11 text Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing Marie-Francine Moens editor Xuanjing Huang editor Lucia Specia editor Scott Wen-tau Yih editor Association for Computational Linguistics Online and Punta Cana, Dominican Republic conference publication zhang-etal-2021-enlivening 10.18653/v1/2021.emnlp-main.260 https://aclanthology.org/2021.emnlp-main.260/ 2021-11 3238 3248