Learning Adaptive Axis Attentions in Fine-tuning: Beyond Fixed Sparse Attention Patterns

Learning Adaptive Axis Attentions in Fine-tuning: Beyond Fixed Sparse Attention Patterns Zihan Wang author Jiuxiang Gu author Jason Kuen author Handong Zhao author Vlad Morariu author Ruiyi Zhang author Ani Nenkova author Tong Sun author Jingbo Shang author 2022-05 text Findings of the Association for Computational Linguistics: ACL 2022 Smaranda Muresan editor Preslav Nakov editor Aline Villavicencio editor Association for Computational Linguistics Dublin, Ireland conference publication wang-etal-2022-learning 10.18653/v1/2022.findings-acl.74 https://aclanthology.org/2022.findings-acl.74/ 2022-05 916 925