On the utility of enhancing BERT syntactic bias with Token Reordering Pretraining

On the utility of enhancing BERT syntactic bias with Token Reordering Pretraining Yassir El Mesbahi author Atif Mahmud author Abbas Ghaddar author Mehdi Rezagholizadeh author Phillippe Langlais author Prasanna Parthasarathi author 2023-12 text Proceedings of the 27th Conference on Computational Natural Language Learning (CoNLL) Jing Jiang editor David Reitter editor Shumin Deng editor Association for Computational Linguistics Singapore conference publication el-mesbahi-etal-2023-utility 10.18653/v1/2023.conll-1.12 https://aclanthology.org/2023.conll-1.12/ 2023-12 165 182