When classifying grammatical role, BERT doesn’t care about word order... except when it matters

When classifying grammatical role, BERT doesn’t care about word order... except when it matters Isabel Papadimitriou author Richard Futrell author Kyle Mahowald author 2022-05 text Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) Smaranda Muresan editor Preslav Nakov editor Aline Villavicencio editor Association for Computational Linguistics Dublin, Ireland conference publication papadimitriou-etal-2022-classifying-grammatical 10.18653/v1/2022.acl-short.71 https://aclanthology.org/2022.acl-short.71/ 2022-05 636 643