When to Use Efficient Self Attention? Profiling Text, Speech and Image Transformer Variants

When to Use Efficient Self Attention? Profiling Text, Speech and Image Transformer Variants Anuj Diwan author Eunsol Choi author David Harwath author 2023-07 text Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) Anna Rogers editor Jordan Boyd-Graber editor Naoaki Okazaki editor Association for Computational Linguistics Toronto, Canada conference publication diwan-etal-2023-use 10.18653/v1/2023.acl-short.141 https://aclanthology.org/2023.acl-short.141/ 2023-07 1639 1650