Head-wise Shareable Attention for Large Language Models

Zouying Cao, Yifei Yang, Hai Zhao


Anthology ID:
2024.findings-emnlp.144
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2024
Month:
November
Year:
2024
Address:
Miami, Florida, USA
Editors:
Yaser Al-Onaizan, Mohit Bansal, Yun-Nung Chen
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
2555–2571
Language:
URL:
https://aclanthology.org/2024.findings-emnlp.144
DOI:
Bibkey:
Cite (ACL):
Zouying Cao, Yifei Yang, and Hai Zhao. 2024. Head-wise Shareable Attention for Large Language Models. In Findings of the Association for Computational Linguistics: EMNLP 2024, pages 2555–2571, Miami, Florida, USA. Association for Computational Linguistics.
Cite (Informal):
Head-wise Shareable Attention for Large Language Models (Cao et al., Findings 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.findings-emnlp.144.pdf
Software:
 2024.findings-emnlp.144.software.zip