Limitations of Knowledge Distillation for Zero-shot Transfer Learning

Limitations of Knowledge Distillation for Zero-shot Transfer Learning Saleh Soltan author Haidar Khan author Wael Hamza author 2021-11 text Proceedings of the Second Workshop on Simple and Efficient Natural Language Processing Nafise Sadat Moosavi editor Iryna Gurevych editor Angela Fan editor Thomas Wolf editor Yufang Hou editor Ana Marasović editor Sujith Ravi editor Association for Computational Linguistics Virtual conference publication soltan-etal-2021-limitations 10.18653/v1/2021.sustainlp-1.3 https://aclanthology.org/2021.sustainlp-1.3/ 2021-11 22 31