Shayan Mohajer Hamidi
Author directory2026
CE-GAD: Curriculum-Efficient On-Policy Adversarial Distillation of Large Language Models
Wenhui Zhu | Hejian Sang | Xiwen Chen | Zhipeng Wang | Shayan Mohajer Hamidi | Han Yu | Jingjing Wang | Yuanda Xu | Xuanzhao Dong | Zhengze Zhou | Ran He | Jelena Markovic-Voronov | Kayhan Behdin | Sayan Ghosh | Alborz Geramifard
Findings of the Association for Computational Linguistics: EMNLP 2026
Wenhui Zhu | Hejian Sang | Xiwen Chen | Zhipeng Wang | Shayan Mohajer Hamidi | Han Yu | Jingjing Wang | Yuanda Xu | Xuanzhao Dong | Zhengze Zhou | Ran He | Jelena Markovic-Voronov | Kayhan Behdin | Sayan Ghosh | Alborz Geramifard
Findings of the Association for Computational Linguistics: EMNLP 2026
Generative adversarial distillation (GAD) provides on-policy feedback for black-box distillation by training a discriminator that ranks teacher and student responses to the same prompt. While effective, GAD is also costly: every step pays for a discriminator update, an actor update over the full response, and the indirect cost of recovering whenever the discriminator and the actor progress at incompatible rates. We argue that the right way to make GAD efficient is not to make individual updates cheaper but to decide **when each update is worth its cost**. We introduce **curriculum-efficient GAD (CE-GAD)**, an adaptive recipe that monitors a small set of training signals and uses them to:
- (i) skip discriminator updates that would not change the reward, - (ii) constrain actor updates and prune per-token gradients to the subset that actually carries signal, and - (iii) rescale rewards and normalize advantages to preserve within-batch contrast under saturation.
Evaluations across four models from two open-source families (Qwen2.5 at 3B/7B/14B and Llama-3.2-3B) demonstrate that CE-GAD matches or surpasses vanilla GAD on quality while winning on 12 out of 16 individual benchmark configurations. Specifically, on Qwen2.5-7B, CE-GAD improves the average score by up to **+3%** relative compared to the base model, while reducing per-step wall-clock time by up to **8x** relative to vanilla GAD.
- (i) skip discriminator updates that would not change the reward, - (ii) constrain actor updates and prune per-token gradients to the subset that actually carries signal, and - (iii) rescale rewards and normalize advantages to preserve within-batch contrast under saturation.
Evaluations across four models from two open-source families (Qwen2.5 at 3B/7B/14B and Llama-3.2-3B) demonstrate that CE-GAD matches or surpasses vanilla GAD on quality while winning on 12 out of 16 individual benchmark configurations. Specifically, on Qwen2.5-7B, CE-GAD improves the average score by up to **+3%** relative compared to the base model, while reducing per-step wall-clock time by up to **8x** relative to vanilla GAD.