Distiller: A Systematic Study of Model Distillation Methods in Natural Language Processing Haoyu He author Xingjian Shi author Jonas Mueller author Sheng Zha author Mu Li author George Karypis author 2021-11 text Proceedings of the Second Workshop on Simple and Efficient Natural Language Processing Nafise Sadat Moosavi editor Iryna Gurevych editor Angela Fan editor Thomas Wolf editor Yufang Hou editor Ana Marasović editor Sujith Ravi editor Association for Computational Linguistics Virtual conference publication he-etal-2021-distiller 10.18653/v1/2021.sustainlp-1.13 https://aclanthology.org/2021.sustainlp-1.13/ 2021-11 119 133