What Does BERT Look at? An Analysis of BERT’s Attention

What Does BERT Look at? An Analysis of BERT’s Attention Kevin Clark author Urvashi Khandelwal author Omer Levy author Christopher D Manning author 2019-08 text Proceedings of the 2019 ACL Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP Tal Linzen editor Grzegorz Chrupała editor Yonatan Belinkov editor Dieuwke Hupkes editor Association for Computational Linguistics Florence, Italy conference publication clark-etal-2019-bert 10.18653/v1/W19-4828 https://aclanthology.org/W19-4828/ 2019-08 276 286