Mixture-of-Modules: Reinventing Transformers as Dynamic Assemblies of Modules

Mixture-of-Modules: Reinventing Transformers as Dynamic Assemblies of Modules Zhuocheng Gong author Ang Lv author Jian Guan author Wei Wu author Huishuai Zhang author Minlie Huang author Dongyan Zhao author Rui Yan author 2024-11 text Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing Yaser Al-Onaizan editor Mohit Bansal editor Yun-Nung Chen editor Association for Computational Linguistics Miami, Florida, USA conference publication gong-etal-2024-mixture 10.18653/v1/2024.emnlp-main.1164 https://aclanthology.org/2024.emnlp-main.1164/ 2024-11 20924 20938