Knowledge Distillation vs. Pretraining from Scratch under a Fixed (Computation) Budget Minh Duc Bui author Fabian Schmidt author Goran Glavaš author Katharina Von Der Wense author 2024-06 text Proceedings of the Fifth Workshop on Insights from Negative Results in NLP Shabnam Tafreshi editor Arjun Akula editor João Sedoc editor Aleksandr Drozd editor Anna Rogers editor Anna Rumshisky editor Association for Computational Linguistics Mexico City, Mexico conference publication bui-etal-2024-knowledge 10.18653/v1/2024.insights-1.6 https://aclanthology.org/2024.insights-1.6/ 2024-06 41 47