AFPQ: Asymmetric Floating Point Quantization for LLMs

AFPQ: Asymmetric Floating Point Quantization for LLMs Yijia Zhang author Sicheng Zhang author Shijie Cao author DaYou Du author Jianyu Wei author Ting Cao author Ningyi Xu author 2024-08 text Findings of the Association for Computational Linguistics: ACL 2024 Lun-Wei Ku editor Andre Martins editor Vivek Srikumar editor Association for Computational Linguistics Bangkok, Thailand conference publication zhang-etal-2024-afpq 10.18653/v1/2024.findings-acl.3 https://aclanthology.org/2024.findings-acl.3/ 2024-08 28 36