Draft on the Fly: Adaptive Self-Speculative Decoding using Cosine Similarity

Draft on the Fly: Adaptive Self-Speculative Decoding using Cosine Similarity Michael R Metel author Peng Lu author Boxing Chen author Mehdi Rezagholizadeh author Ivan Kobyzev author 2024-11 text Findings of the Association for Computational Linguistics: EMNLP 2024 Yaser Al-Onaizan editor Mohit Bansal editor Yun-Nung Chen editor Association for Computational Linguistics Miami, Florida, USA conference publication metel-etal-2024-draft 10.18653/v1/2024.findings-emnlp.124 https://aclanthology.org/2024.findings-emnlp.124/ 2024-11 2267 2272