Interpreting Context Look-ups in Transformers: Investigating Attention-MLP Interactions

Interpreting Context Look-ups in Transformers: Investigating Attention-MLP Interactions Clement Neo author Shay B Cohen author Fazl Barez author 2024-11 text Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing Yaser Al-Onaizan editor Mohit Bansal editor Yun-Nung Chen editor Association for Computational Linguistics Miami, Florida, USA conference publication neo-etal-2024-interpreting 10.18653/v1/2024.emnlp-main.930 https://aclanthology.org/2024.emnlp-main.930/ 2024-11 16681 16697