Learning Better Masking for Better Language Model Pre-training

Learning Better Masking for Better Language Model Pre-training Dongjie Yang author Zhuosheng Zhang author Hai Zhao author 2023-07 text Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) Anna Rogers editor Jordan Boyd-Graber editor Naoaki Okazaki editor Association for Computational Linguistics Toronto, Canada conference publication yang-etal-2023-learning 10.18653/v1/2023.acl-long.400 https://aclanthology.org/2023.acl-long.400/ 2023-07 7255 7267