On the Role of Bidirectionality in Language Model Pre-Training Mikel Artetxe author Jingfei Du author Naman Goyal author Luke Zettlemoyer author Veselin Stoyanov author 2022-12 text Findings of the Association for Computational Linguistics: EMNLP 2022 Yoav Goldberg editor Zornitsa Kozareva editor Yue Zhang editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates conference publication artetxe-etal-2022-role 10.18653/v1/2022.findings-emnlp.293 https://aclanthology.org/2022.findings-emnlp.293/ 2022-12 3973 3985