How much pretraining data do language models need to learn syntax?

How much pretraining data do language models need to learn syntax? Laura Pérez-Mayos author Miguel Ballesteros author Leo Wanner author 2021-11 text Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing Marie-Francine Moens editor Xuanjing Huang editor Lucia Specia editor Scott Wen-tau Yih editor Association for Computational Linguistics Online and Punta Cana, Dominican Republic conference publication perez-mayos-etal-2021-much 10.18653/v1/2021.emnlp-main.118 https://aclanthology.org/2021.emnlp-main.118/ 2021-11 1571 1582