Dynamic Masking Rate Schedules for MLM Pretraining Zachary Ankner author Naomi Saphra author Davis Blalock author Jonathan Frankle author Matthew Leavitt author 2024-03 text Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics (Volume 2: Short Papers) Yvette Graham editor Matthew Purver editor Association for Computational Linguistics St. Julian’s, Malta conference publication ankner-etal-2024-dynamic 10.18653/v1/2024.eacl-short.42 https://aclanthology.org/2024.eacl-short.42/ 2024-03 477 487