A Mixture of h - 1 Heads is Better than h Heads

A Mixture of h - 1 Heads is Better than h Heads Hao Peng author Roy Schwartz author Dianqi Li author Noah A Smith author 2020-07 text Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics Dan Jurafsky editor Joyce Chai editor Natalie Schluter editor Joel Tetreault editor Association for Computational Linguistics Online conference publication peng-etal-2020-mixture 10.18653/v1/2020.acl-main.587 https://aclanthology.org/2020.acl-main.587/ 2020-07 6566 6577