ProSparse: Introducing and Enhancing Intrinsic Activation Sparsity within Large Language Models

ProSparse: Introducing and Enhancing Intrinsic Activation Sparsity within Large Language Models Chenyang Song author Xu Han author Zhengyan Zhang author Shengding Hu author Xiyu Shi author Kuai Li author Chen Chen author Zhiyuan Liu author Guangli Li author Tao Yang author Maosong Sun author 2025-01 text Proceedings of the 31st International Conference on Computational Linguistics Owen Rambow editor Leo Wanner editor Marianna Apidianaki editor Hend Al-Khalifa editor Barbara Di Eugenio editor Steven Schockaert editor Association for Computational Linguistics Abu Dhabi, UAE conference publication song-etal-2025-prosparse https://aclanthology.org/2025.coling-main.180/ 2025-01 2626 2644