Mitigating Language-Level Performance Disparity in mPLMs via Teacher Language Selection and Cross-lingual Self-Distillation

Mitigating Language-Level Performance Disparity in mPLMs via Teacher Language Selection and Cross-lingual Self-Distillation Haozhe Zhao author Zefan Cai author Shuzheng Si author Liang Chen author Yufeng He author Kaikai An author Baobao Chang author 2024-06 text Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers) Kevin Duh editor Helena Gomez editor Steven Bethard editor Association for Computational Linguistics Mexico City, Mexico conference publication zhao-etal-2024-mitigating 10.18653/v1/2024.naacl-long.160 https://aclanthology.org/2024.naacl-long.160/ 2024-06 2893 2907