Co-training and Co-distillation for Quality Improvement and Compression of Language Models

Co-training and Co-distillation for Quality Improvement and Compression of Language Models Hayeon Lee author Rui Hou author Jongpil Kim author Davis Liang author Hongbo Zhang author Sung Hwang author Alexander Min author 2023-12 text Findings of the Association for Computational Linguistics: EMNLP 2023 Houda Bouamor editor Juan Pino editor Kalika Bali editor Association for Computational Linguistics Singapore conference publication lee-etal-2023-co 10.18653/v1/2023.findings-emnlp.500 https://aclanthology.org/2023.findings-emnlp.500/ 2023-12 7458 7467