MELoRA: Mini-Ensemble Low-Rank Adapters for Parameter-Efficient Fine-Tuning

MELoRA: Mini-Ensemble Low-Rank Adapters for Parameter-Efficient Fine-Tuning Pengjie Ren author Chengshun Shi author Shiguang Wu author Mengqi Zhang author Zhaochun Ren author Maarten de Rijke author Zhumin Chen author Jiahuan Pei author 2024-08 text Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) Lun-Wei Ku editor Andre Martins editor Vivek Srikumar editor Association for Computational Linguistics Bangkok, Thailand conference publication ren-etal-2024-melora 10.18653/v1/2024.acl-long.168 https://aclanthology.org/2024.acl-long.168/ 2024-08 3052 3064