Bridging the Gap between Decision and Logits in Decision-based Knowledge Distillation for Pre-trained Language Models

Bridging the Gap between Decision and Logits in Decision-based Knowledge Distillation for Pre-trained Language Models Qinhong Zhou author Zonghan Yang author Peng Li author Yang Liu author 2023-07 text Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) Anna Rogers editor Jordan Boyd-Graber editor Naoaki Okazaki editor Association for Computational Linguistics Toronto, Canada conference publication zhou-etal-2023-bridging 10.18653/v1/2023.acl-long.738 https://aclanthology.org/2023.acl-long.738/ 2023-07 13234 13248