Improved Multilingual Language Model Pretraining for Social Media Text via Translation Pair Prediction

Improved Multilingual Language Model Pretraining for Social Media Text via Translation Pair Prediction Shubhanshu Mishra author Aria Haghighi author 2021-11 text Proceedings of the Seventh Workshop on Noisy User-generated Text (W-NUT 2021) Wei Xu editor Alan Ritter editor Tim Baldwin editor Afshin Rahimi editor Association for Computational Linguistics Online conference publication mishra-haghighi-2021-improved 10.18653/v1/2021.wnut-1.42 https://aclanthology.org/2021.wnut-1.42/ 2021-11 381 388