Revisiting Token Dropping Strategy in Efficient BERT Pretraining

Revisiting Token Dropping Strategy in Efficient BERT Pretraining Qihuang Zhong author Liang Ding author Juhua Liu author Xuebo Liu author Min Zhang author Bo Du author Dacheng Tao author 2023-07 text Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) Anna Rogers editor Jordan Boyd-Graber editor Naoaki Okazaki editor Association for Computational Linguistics Toronto, Canada conference publication zhong-etal-2023-revisiting 10.18653/v1/2023.acl-long.579 https://aclanthology.org/2023.acl-long.579/ 2023-07 10391 10405