MicroBERT: Effective Training of Low-resource Monolingual BERTs through Parameter Reduction and Multitask Learning

MicroBERT: Effective Training of Low-resource Monolingual BERTs through Parameter Reduction and Multitask Learning Luke Gessler author Amir Zeldes author 2022-12 text Proceedings of the 2nd Workshop on Multi-lingual Representation Learning (MRL) Duygu Ataman editor Hila Gonen editor Sebastian Ruder editor Orhan Firat editor Gözde Gül Sahin editor Jamshidbek Mirzakhalov editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication gessler-zeldes-2022-microbert 10.18653/v1/2022.mrl-1.9 https://aclanthology.org/2022.mrl-1.9/ 2022-12 86 99