Contrastive Distillation on Intermediate Representations for Language Model Compression Siqi Sun author Zhe Gan author Yuwei Fang author Yu Cheng author Shuohang Wang author Jingjing Liu author 2020-11 text Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) Bonnie Webber editor Trevor Cohn editor Yulan He editor Yang Liu editor Association for Computational Linguistics Online conference publication sun-etal-2020-contrastive 10.18653/v1/2020.emnlp-main.36 https://aclanthology.org/2020.emnlp-main.36/ 2020-11 498 508