Jianxin Xue
Author directory2026
TipCoder: Reinforcement Learning Boosted Test-time Instruction Proposer for Code Generation
Minyu Chen | Sihao Wu | Ling-I Wu | Song Qin | Jingyang Li | Lei Ning | Jianxin Xue | Guoqiang Li
Findings of the Association for Computational Linguistics: EMNLP 2026
Minyu Chen | Sihao Wu | Ling-I Wu | Song Qin | Jingyang Li | Lei Ning | Jianxin Xue | Guoqiang Li
Findings of the Association for Computational Linguistics: EMNLP 2026
Test-time scaling for code generation typically explores the solution space by sampling multiple programs from a fixed instruction. We study a complementary direction: instance-level instruction-space exploration. Our observation is that many coding failures stem from missing constraints, overlooked edge cases, or misleading reasoning paths induced by the original prompt. To address this, we propose TipCoder, a test-time instruction proposer that generates problem-specific auxiliary tips before code synthesis. TipCoder distills multi-turn debugging trajectories into proactive guidance and further optimizes the Proposer with reinforcement learning using a marginal-utility reward. At inference time, it generates both a base solution and a tip-guided solution, and applies a Reward Model for post-hoc selection. This exploration-selection design allows tips to expose additional candidate potential while reducing regressions from unnecessary guidance. Across multiple code-generation benchmarks and target Code LLMs, TipCoder provides a robust instruction-level test-time scaling strategy, comparing favorably with stochastic sampling and generic prompt optimization baselines under a shared reward-model-based selection protocol.
2025
Co-Eval: Augmenting LLM-based Evaluation with Machine Metrics
Ling-I Wu | Weijie Wu | Minyu Chen | Jianxin Xue | Guoqiang Li
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Ling-I Wu | Weijie Wu | Minyu Chen | Jianxin Xue | Guoqiang Li
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Large language models (LLMs) are increasingly used as evaluators in natural language generation tasks, offering advantages in scalability and interpretability over traditional evaluation methods. However, existing LLM-based evaluations often suffer from biases and misalignment, particularly in domain-specific tasks, due to limited functional understanding and knowledge gaps. To address these challenges, we first investigate the relationship between an LLM-based evaluator’s familiarity with the target task and its evaluation performance. We then introduce the Co-Eval framework, which leverages a criteria planner model and optimized machine metrics to enhance the scalability and fairness of LLM-based evaluation. Experimental results on both general and domain-specific tasks demonstrate that Co-Eval reduces biases, achieving up to a 0.4903 reduction in self-preference bias, and improves alignment with human preferences, with gains of up to 0.324 in Spearman correlation.