RA-LoRA: Rank-Adaptive Parameter-Efficient Fine-Tuning for Accurate 2-bit Quantized Large Language Models

RA-LoRA: Rank-Adaptive Parameter-Efficient Fine-Tuning for Accurate 2-bit Quantized Large Language Models Minsoo Kim author Sihwa Lee author Wonyong Sung author Jungwook Choi author 2024-08 text Findings of the Association for Computational Linguistics: ACL 2024 Lun-Wei Ku editor Andre Martins editor Vivek Srikumar editor Association for Computational Linguistics Bangkok, Thailand conference publication kim-etal-2024-ra 10.18653/v1/2024.findings-acl.933 https://aclanthology.org/2024.findings-acl.933/ 2024-08 15773 15786