How Much Do Modifications to Transformer Language Models Affect Their Ability to Learn Linguistic Knowledge?

How Much Do Modifications to Transformer Language Models Affect Their Ability to Learn Linguistic Knowledge? Simeng Sun author Brian Dillon author Mohit Iyyer author 2022-05 text Proceedings of the Third Workshop on Insights from Negative Results in NLP Shabnam Tafreshi editor João Sedoc editor Anna Rogers editor Aleksandr Drozd editor Anna Rumshisky editor Arjun Akula editor Association for Computational Linguistics Dublin, Ireland conference publication sun-etal-2022-much 10.18653/v1/2022.insights-1.6 https://aclanthology.org/2022.insights-1.6/ 2022-05 46 53