Pit One Against Many: Leveraging Attention-head Embeddings for Parameter-efficient Multi-head Attention

Pit One Against Many: Leveraging Attention-head Embeddings for Parameter-efficient Multi-head Attention Huiyin Xue author Nikolaos Aletras author 2023-12 text Findings of the Association for Computational Linguistics: EMNLP 2023 Houda Bouamor editor Juan Pino editor Kalika Bali editor Association for Computational Linguistics Singapore conference publication xue-aletras-2023-pit 10.18653/v1/2023.findings-emnlp.695 https://aclanthology.org/2023.findings-emnlp.695/ 2023-12 10355 10373