Not all layers are equally as important: Every Layer Counts BERT

Not all layers are equally as important: Every Layer Counts BERT Lucas Georges Gabriel Charpentier author David Samuel author 2023-12 text Proceedings of the BabyLM Challenge at the 27th Conference on Computational Natural Language Learning Alex Warstadt editor Aaron Mueller editor Leshem Choshen editor Ethan Wilcox editor Chengxu Zhuang editor Juan Ciro editor Rafael Mosquera editor Bhargavi Paranjabe editor Adina Williams editor Tal Linzen editor Ryan Cotterell editor Association for Computational Linguistics Singapore conference publication georges-gabriel-charpentier-samuel-2023-layers 10.18653/v1/2023.conll-babylm.20 https://aclanthology.org/2023.conll-babylm.20/ 2023-12 238 252