Do Transformers Parse while Predicting the Masked Word?

Do Transformers Parse while Predicting the Masked Word? Haoyu Zhao author Abhishek Panigrahi author Rong Ge author Sanjeev Arora author 2023-12 text Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing Houda Bouamor editor Juan Pino editor Kalika Bali editor Association for Computational Linguistics Singapore conference publication zhao-etal-2023-transformers 10.18653/v1/2023.emnlp-main.1029 https://aclanthology.org/2023.emnlp-main.1029/ 2023-12 16513 16542