Fine- and Coarse-Granularity Hybrid Self-Attention for Efficient BERT

Fine- and Coarse-Granularity Hybrid Self-Attention for Efficient BERT Jing Zhao author Yifan Wang author Junwei Bao author Youzheng Wu author Xiaodong He author 2022-05 text Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) Smaranda Muresan editor Preslav Nakov editor Aline Villavicencio editor Association for Computational Linguistics Dublin, Ireland conference publication zhao-etal-2022-fine 10.18653/v1/2022.acl-long.330 https://aclanthology.org/2022.acl-long.330/ 2022-05 4811 4820