AutoMoE: Heterogeneous Mixture-of-Experts with Adaptive Computation for Efficient Neural Machine Translation

AutoMoE: Heterogeneous Mixture-of-Experts with Adaptive Computation for Efficient Neural Machine Translation Ganesh Jawahar author Subhabrata Mukherjee author Xiaodong Liu author Young Jin Kim author Muhammad Abdul-Mageed author V.S., Laks Lakshmanan author Ahmed Hassan Awadallah author Sebastien Bubeck author Jianfeng Gao author 2023-07 text Findings of the Association for Computational Linguistics: ACL 2023 Anna Rogers editor Jordan Boyd-Graber editor Naoaki Okazaki editor Association for Computational Linguistics Toronto, Canada conference publication jawahar-etal-2023-automoe 10.18653/v1/2023.findings-acl.580 https://aclanthology.org/2023.findings-acl.580/ 2023-07 9116 9132