Pre-training a BERT with Curriculum Learning by Increasing Block-Size of Input Text

Pre-training a BERT with Curriculum Learning by Increasing Block-Size of Input Text Koichi Nagatsuka author Clifford Broni-Bediako author Masayasu Atsumi author 2021-09 text Proceedings of the International Conference on Recent Advances in Natural Language Processing (RANLP 2021) Ruslan Mitkov editor Galia Angelova editor INCOMA Ltd. Held Online conference publication nagatsuka-etal-2021-pre https://aclanthology.org/2021.ranlp-1.112/ 2021-09 989 996