Multistage Collaborative Knowledge Distillation from a Large Language Model for Semi-Supervised Sequence Generation

Multistage Collaborative Knowledge Distillation from a Large Language Model for Semi-Supervised Sequence Generation Jiachen Zhao author Wenlong Zhao author Andrew Drozdov author Benjamin Rozonoyer author Md Arafat Sultan author Jay-Yoon Lee author Mohit Iyyer author Andrew McCallum author 2024-08 text Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) Lun-Wei Ku editor Andre Martins editor Vivek Srikumar editor Association for Computational Linguistics Bangkok, Thailand conference publication zhao-etal-2024-multistage 10.18653/v1/2024.acl-long.766 https://aclanthology.org/2024.acl-long.766/ 2024-08 14201 14214