EAGLE-2: Faster Inference of Language Models with Dynamic Draft Trees

EAGLE-2: Faster Inference of Language Models with Dynamic Draft Trees Yuhui Li author Fangyun Wei author Chao Zhang author Hongyang Zhang author 2024-11 text Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing Yaser Al-Onaizan editor Mohit Bansal editor Yun-Nung Chen editor Association for Computational Linguistics Miami, Florida, USA conference publication li-etal-2024-eagle 10.18653/v1/2024.emnlp-main.422 https://aclanthology.org/2024.emnlp-main.422/ 2024-11 7421 7432