Not all parameters are born equal: Attention is mostly what you need

Not all parameters are born equal: Attention is mostly what you need Nikolay Bogoychev author 2021-11 text Proceedings of the Fourth BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP Jasmijn Bastings editor Yonatan Belinkov editor Emmanuel Dupoux editor Mario Giulianelli editor Dieuwke Hupkes editor Yuval Pinter editor Hassan Sajjad editor Association for Computational Linguistics Punta Cana, Dominican Republic conference publication bogoychev-2021-parameters 10.18653/v1/2021.blackboxnlp-1.28 https://aclanthology.org/2021.blackboxnlp-1.28/ 2021-11 363 374