Multi-level Distillation of Semantic Knowledge for Pre-training Multilingual Language Model

Multi-level Distillation of Semantic Knowledge for Pre-training Multilingual Language Model Mingqi Li author Fei Ding author Dan Zhang author Long Cheng author Hongxin Hu author Feng Luo author 2022-12 text Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing Yoav Goldberg editor Zornitsa Kozareva editor Yue Zhang editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates conference publication li-etal-2022-multi-level 10.18653/v1/2022.emnlp-main.202 https://aclanthology.org/2022.emnlp-main.202/ 2022-12 3097 3106