VE-KD: Vocabulary-Expansion Knowledge-Distillation for Training Smaller Domain-Specific Language Models

VE-KD: Vocabulary-Expansion Knowledge-Distillation for Training Smaller Domain-Specific Language Models Pengju Gao author Tomohiro Yamasaki author Kazunori Imoto author 2024-11 text Findings of the Association for Computational Linguistics: EMNLP 2024 Yaser Al-Onaizan editor Mohit Bansal editor Yun-Nung Chen editor Association for Computational Linguistics Miami, Florida, USA conference publication gao-etal-2024-kd 10.18653/v1/2024.findings-emnlp.884 https://aclanthology.org/2024.findings-emnlp.884/ 2024-11 15046 15059