Dual-Space Knowledge Distillation for Large Language Models

Dual-Space Knowledge Distillation for Large Language Models Songming Zhang author Xue Zhang author Zengkui Sun author Yufeng Chen author Jinan Xu author 2024-11 text Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing Yaser Al-Onaizan editor Mohit Bansal editor Yun-Nung Chen editor Association for Computational Linguistics Miami, Florida, USA conference publication zhang-etal-2024-dual 10.18653/v1/2024.emnlp-main.1010 https://aclanthology.org/2024.emnlp-main.1010/ 2024-11 18164 18181