Head-wise Shareable Attention for Large Language Models

Head-wise Shareable Attention for Large Language Models Zouying Cao author Yifei Yang author Hai Zhao author 2024-11 text Findings of the Association for Computational Linguistics: EMNLP 2024 Yaser Al-Onaizan editor Mohit Bansal editor Yun-Nung Chen editor Association for Computational Linguistics Miami, Florida, USA conference publication cao-etal-2024-head 10.18653/v1/2024.findings-emnlp.144 https://aclanthology.org/2024.findings-emnlp.144/ 2024-11 2555 2571