HiFi: High-Information Attention Heads Hold for Parameter-Efficient Model Adaptation

HiFi: High-Information Attention Heads Hold for Parameter-Efficient Model Adaptation Anchun Gui author Han Xiao author 2023-07 text Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) Anna Rogers editor Jordan Boyd-Graber editor Naoaki Okazaki editor Association for Computational Linguistics Toronto, Canada conference publication gui-xiao-2023-hifi 10.18653/v1/2023.acl-long.475 https://aclanthology.org/2023.acl-long.475/ 2023-07 8521 8537