DPA-MoE: A Runtime Precision Control Framework for MoE Inference

Jaeyun Kim, Hoonki Lee, Susie Shin, Hyunmin Kim, Dahyun Lee, Sangyeob Kim


Abstract
Mixture-of-Experts (MoE) models reduce computation by routing each token to a small set of experts, but each selected expert is still used at a fixed precision. We present DPA-MoE, a runtime precision control framework that makes routed experts any-precision. DPA-MoE encodes expert feed-forward weights as prefix-decodable chunks using SharedScale AnyBCQ, profiles per-expert reconstruction residuals offline, and allocates chunks at inference time using live router gate scores. This post-routing allocation lets a single encoded MoE checkpoint operate at multiple effective weight budgets without retraining or re-encoding. Experiments on Qwen3-30B-A3B and DeepSeekMoE-16B show that DPA-MoE improves KL divergence and downstream accuracy over uniform chunk allocation at matched budgets, with modest steady-state throughput overhead in our prototype.
Anthology ID:
2026.findings-emnlp.1076
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
22761–22778
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.1076/
DOI:
10.18653/2026.findings-emnlp.1076
Bibkey:
Cite (ACL):
Jaeyun Kim, Hoonki Lee, Susie Shin, Hyunmin Kim, Dahyun Lee, and Sangyeob Kim. 2026. DPA-MoE: A Runtime Precision Control Framework for MoE Inference. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 22761–22778, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
DPA-MoE: A Runtime Precision Control Framework for MoE Inference (Kim et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.1076.pdf