Empowering parameter-efficient transfer learning by recognizing the kernel structure in self-attention

Empowering parameter-efficient transfer learning by recognizing the kernel structure in self-attention Yifan Chen author Devamanyu Hazarika author Mahdi Namazifar author Yang Liu author Di Jin author Dilek Hakkani-Tur author 2022-07 text Findings of the Association for Computational Linguistics: NAACL 2022 Marine Carpuat editor Marie-Catherine de Marneffe editor Ivan Vladimir Meza Ruiz editor Association for Computational Linguistics Seattle, United States conference publication chen-etal-2022-empowering 10.18653/v1/2022.findings-naacl.102 https://aclanthology.org/2022.findings-naacl.102/ 2022-07 1375 1388