Transformer visualization via dictionary learning: contextualized embedding as a linear superposition of transformer factors

Transformer visualization via dictionary learning: contextualized embedding as a linear superposition of transformer factors Zeyu Yun author Yubei Chen author Bruno Olshausen author Yann LeCun author 2021-06 text Proceedings of Deep Learning Inside Out (DeeLIO): The 2nd Workshop on Knowledge Extraction and Integration for Deep Learning Architectures Eneko Agirre editor Marianna Apidianaki editor Ivan Vulić editor Association for Computational Linguistics Online conference publication yun-etal-2021-transformer 10.18653/v1/2021.deelio-1.1 https://aclanthology.org/2021.deelio-1.1/ 2021-06 1 10