RoseLoRA: Row and Column-wise Sparse Low-rank Adaptation of Pre-trained Language Model for Knowledge Editing and Fine-tuning

RoseLoRA: Row and Column-wise Sparse Low-rank Adaptation of Pre-trained Language Model for Knowledge Editing and Fine-tuning Haoyu Wang author Tianci Liu author Ruirui Li author Monica Xiao Cheng author Tuo Zhao author Jing Gao author 2024-11 text Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing Yaser Al-Onaizan editor Mohit Bansal editor Yun-Nung Chen editor Association for Computational Linguistics Miami, Florida, USA conference publication wang-etal-2024-roselora 10.18653/v1/2024.emnlp-main.57 https://aclanthology.org/2024.emnlp-main.57/ 2024-11 996 1008