MoDULA: Mixture of Domain-Specific and Universal LoRA for Multi-Task Learning

MoDULA: Mixture of Domain-Specific and Universal LoRA for Multi-Task Learning Yufei Ma author Zihan Liang author Huangyu Dai author Ben Chen author Dehong Gao author Zhuoran Ran author Wang Zihan author Linbo Jin author Wen Jiang author Guannan Zhang author Xiaoyan Cai author Libin Yang author 2024-11 text Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing Yaser Al-Onaizan editor Mohit Bansal editor Yun-Nung Chen editor Association for Computational Linguistics Miami, Florida, USA conference publication ma-etal-2024-modula 10.18653/v1/2024.emnlp-main.161 https://aclanthology.org/2024.emnlp-main.161/ 2024-11 2758 2770