Extending Context Window of Large Language Models from a Distributional Perspective

Extending Context Window of Large Language Models from a Distributional Perspective Yingsheng Wu author Yuxuan Gu author Xiaocheng Feng author Weihong Zhong author Dongliang Xu author Qing Yang author Hongtao Liu author Bing Qin author 2024-11 text Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing Yaser Al-Onaizan editor Mohit Bansal editor Yun-Nung Chen editor Association for Computational Linguistics Miami, Florida, USA conference publication wu-etal-2024-extending 10.18653/v1/2024.emnlp-main.414 https://aclanthology.org/2024.emnlp-main.414/ 2024-11 7288 7301