Data-Informed Global Sparseness in Attention Mechanisms for Deep Neural Networks

Data-Informed Global Sparseness in Attention Mechanisms for Deep Neural Networks Ileana Rugina author Rumen Dangovski author Li Jing author Preslav Nakov author Marin Soljacic author 2024-05 text Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024) Nicoletta Calzolari editor Min-Yen Kan editor Veronique Hoste editor Alessandro Lenci editor Sakriani Sakti editor Nianwen Xue editor ELRA and ICCL Torino, Italia conference publication rugina-etal-2024-data https://aclanthology.org/2024.lrec-main.392/ 2024-05 4392 4403