Impossible Distillation for Paraphrasing and Summarization: How to Make High-quality Lemonade out of Small, Low-quality Model

Impossible Distillation for Paraphrasing and Summarization: How to Make High-quality Lemonade out of Small, Low-quality Model Jaehun Jung author Peter West author Liwei Jiang author Faeze Brahman author Ximing Lu author Jillian Fisher author Taylor Sorensen author Yejin Choi author 2024-06 text Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers) Kevin Duh editor Helena Gomez editor Steven Bethard editor Association for Computational Linguistics Mexico City, Mexico conference publication jung-etal-2024-impossible 10.18653/v1/2024.naacl-long.250 https://aclanthology.org/2024.naacl-long.250/ 2024-06 4439 4454