Adaptive Gating in Mixture-of-Experts based Language Models

Adaptive Gating in Mixture-of-Experts based Language Models Jiamin Li author Qiang Su author Yitao Yang author Yimin Jiang author Cong Wang author Hong Xu author 2023-12 text Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing Houda Bouamor editor Juan Pino editor Kalika Bali editor Association for Computational Linguistics Singapore conference publication li-etal-2023-adaptive-gating 10.18653/v1/2023.emnlp-main.217 https://aclanthology.org/2023.emnlp-main.217/ 2023-12 3577 3587