Yuelin Hu
Author directory2026
GAC: Noise-Aware Adaptive Mixing for Hybrid SFT-RL Post-Training
Yuelin Hu | Wei Liu | Zhenbo Yu | Zhengxue Cheng | Li Song
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Yuelin Hu | Wei Liu | Zhenbo Yu | Zhengxue Cheng | Li Song
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Hybrid post-training combining supervised fine-tuning (SFT) and reinforcement learning (RL) is the standard paradigm for aligning large language models, yet fixed mixing schedules cannot adapt when the relative noise of the two signals evolves. We derive a noise-aware mixing weight by minimizing an MSE upper bound on the mixed stochastic gradient, yielding a closed-form that balances gradient noise variance and SFT–RL disagreement. Building on the token-wise reweighting of CHORD (CITATION)