SCA: Selective Compression Attention for Efficiently Extending the Context Window of Large Language Models

SCA: Selective Compression Attention for Efficiently Extending the Context Window of Large Language Models Huanran Zheng author Wei Zhu author Xiaoling Wang author 2024-11 text Findings of the Association for Computational Linguistics: EMNLP 2024 Yaser Al-Onaizan editor Mohit Bansal editor Yun-Nung Chen editor Association for Computational Linguistics Miami, Florida, USA conference publication zheng-etal-2024-sca 10.18653/v1/2024.findings-emnlp.358 https://aclanthology.org/2024.findings-emnlp.358/ 2024-11 6166 6178