QDyLoRA: Quantized Dynamic Low-Rank Adaptation for Efficient Large Language Model Tuning

QDyLoRA: Quantized Dynamic Low-Rank Adaptation for Efficient Large Language Model Tuning Hossein Rajabzadeh author Mojtaba Valipour author Tianshu Zhu author Marzieh S Tahaei author Hyock Ju Kwon author Ali Ghodsi author Boxing Chen author Mehdi Rezagholizadeh author 2024-11 text Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing: Industry Track Franck Dernoncourt editor Daniel Preoţiuc-Pietro editor Anastasia Shimorina editor Association for Computational Linguistics Miami, Florida, US conference publication rajabzadeh-etal-2024-qdylora 10.18653/v1/2024.emnlp-industry.53 https://aclanthology.org/2024.emnlp-industry.53/ 2024-11 712 718