Cache me if you Can: an Online Cost-aware Teacher-Student framework to Reduce the Calls to Large Language Models

Cache me if you Can: an Online Cost-aware Teacher-Student framework to Reduce the Calls to Large Language Models Ilias Stogiannidis author Stavros Vassos author Prodromos Malakasiotis author Ion Androutsopoulos author 2023-12 text Findings of the Association for Computational Linguistics: EMNLP 2023 Houda Bouamor editor Juan Pino editor Kalika Bali editor Association for Computational Linguistics Singapore conference publication stogiannidis-etal-2023-cache 10.18653/v1/2023.findings-emnlp.1000 https://aclanthology.org/2023.findings-emnlp.1000/ 2023-12 14999 15008