Simplicity Bias in Transformers and their Ability to Learn Sparse Boolean Functions

Simplicity Bias in Transformers and their Ability to Learn Sparse Boolean Functions Satwik Bhattamishra author Arkil Patel author Varun Kanade author Phil Blunsom author 2023-07 text Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) Anna Rogers editor Jordan Boyd-Graber editor Naoaki Okazaki editor Association for Computational Linguistics Toronto, Canada conference publication bhattamishra-etal-2023-simplicity 10.18653/v1/2023.acl-long.317 https://aclanthology.org/2023.acl-long.317/ 2023-07 5767 5791