Lin Chen
Author directoryOther people with similar names: Lin Chen, Lin Chen, Lin Chen, Lin Chen, Lin Chen, Lin Chen
Unverified author pages with similar names: Lin Chen
2026
Joint Training of Multi-Token Prediction in Reinforcement Learning via Optimal Coefficient Calibration
Zili Wang | Jiajun Chai | Lin Chen | Xiaohan Wang | Shiming Xiang | Guojun Yin
Findings of the Association for Computational Linguistics: EMNLP 2026
Zili Wang | Jiajun Chai | Lin Chen | Xiaohan Wang | Shiming Xiang | Guojun Yin
Findings of the Association for Computational Linguistics: EMNLP 2026
Reinforcement Learning from Verifiable Rewards (RLVR) has emerged as the standard paradigm for improving reasoning capability of large language models, while Multi-Token Prediction (MTP) has been a widely adopted module in pretraining. Combining the two is a natural approach, yet current RL practices detach MTP gradients because joint training degrades the performance. We revisit this failure from an optimization perspective. We show that the per-step effect of MTP on the RL objective can be decomposed into two terms: a first-order correlation and a second-order perturbation penalty. This decomposition unifies three MTP training regimes: Detach, Cross-Entropy loss, and Policy loss, and explains why each succeeds or fails. Further analysis of policy loss reveals that, although it aligns with intuition, performance still degrades: the correlation term decays while the quadratic penalty persists. Guided by the analysis, we propose Optimal Coefficient Calibration (OCC), an adaptive scheme that tracks the optimal coefficient online via a log-probability proxy at negligible cost. Across six competition-level mathematical reasoning benchmarks, OCC consistently matches or exceeds the detach baseline, delivering improved joint MTP-RL training performance.
DiffPDE: Masked Diffusion Language Models as PDE Solver
Wenxuan Guo | Yuyang Hong | Lubin Fan | Zhaojin Fu | Lin Chen | Kun Ding | Shiming Xiang
Findings of the Association for Computational Linguistics: EMNLP 2026
Wenxuan Guo | Yuyang Hong | Lubin Fan | Zhaojin Fu | Lin Chen | Kun Ding | Shiming Xiang
Findings of the Association for Computational Linguistics: EMNLP 2026
Existing approaches for synthesizing Partial Differential Equation (PDE) solvers predominantly rely on autoregressive models, yet their global left-to-right decoding incurs substantial redundancy when addressing inherently localized bugs. In this work, we challenge this inefficient paradigm and propose DiffPDE, a framework leveraging discrete diffusion language models for targeted code repair. By introducing a localized re-masking and infilling strategy, DiffPDE regenerates only erroneous regions while preserving correct context, naturally aligning generation with the sparse nature of PDE errors. Furthermore, to handle coupled bugs requiring sequential interventions, we present Iterative Debugging GRPO (ID-GRPO), a reinforcement learning scheme that enables multi-round debugging within single trajectories via intermediate rewards. Experiments on PDEBench show that DiffPDE achieves competitive accuracy, outperforms same-scale AR models, and significantly accelerates repair.