Songtao Huang
Author directory2026
RewardCode: Training Generalist Code Reward Model via Pairwise Reinforcement Learning
Songtao Huang | Shiyang Feng | Xiaohan He | Xiangchao Yan | Bo Zhang | Lei Bai
Findings of the Association for Computational Linguistics: EMNLP 2026
Songtao Huang | Shiyang Feng | Xiaohan He | Xiangchao Yan | Bo Zhang | Lei Bai
Findings of the Association for Computational Linguistics: EMNLP 2026
Reward modeling aligns language models with human preferences, yet coding tasks, requiring strict logic and syntax, pose challenges due to their domain diversity. In this paper, we propose RewardCode, a generalist code reward model trained via a two-stage pipeline, enabling scalable and precise evaluation through principle-based scoring and unit test generation. Specifically, the first stage combines Structured Fine-Tuning and Rejective Fine-Tuning to distill cross-domain summarization and code evaluation capabilities from advanced LLMs. The second stage introduces Pairwise-GRPO, a reinforcement learning method that uses preference pairs to improve solution discrimination, while ensuring the generation of consistent and verifiable unit tests. Further, to train a cross-domain code reward model, we construct CodePair-18K, a dataset of verifiable code preference pairs and executable unit tests. Experiments on multiple benchmarks show that RewardCode outperforms strong baselines in evaluation accuracy, verifying its effectiveness in advancing general-purpose code LLMs.
An Automated Pipeline for Provably Retrieval-Dependent Benchmark Construction over Dynamic Knowledge
Heng Zhou | Ao Yu | Yuchen Fan | Li Kang | Jianing Shi | Yongting Zhang | Yutao Fan | Tiancheng He | Yibing Lin | Hejia Geng | Yuhao Wu | Xiufeng Song | Zhemeng Zhang | Songtao Huang | Yiran Qin | Wenlong Zhang | Lei Bai | Zhenfei Yin
Findings of the Association for Computational Linguistics: EMNLP 2026
Heng Zhou | Ao Yu | Yuchen Fan | Li Kang | Jianing Shi | Yongting Zhang | Yutao Fan | Tiancheng He | Yibing Lin | Hejia Geng | Yuhao Wu | Xiufeng Song | Zhemeng Zhang | Songtao Huang | Yiran Qin | Wenlong Zhang | Lei Bai | Zhenfei Yin
Findings of the Association for Computational Linguistics: EMNLP 2026
Static benchmarks often conflate memorization with reasoning, failing to capture the dynamic nature of world knowledge. We present LiveSearchBench, a scalable pipeline that automatically constructs snapshot-grounded benchmarks from knowledge graph differentials, in which every answer is unique and SPARQL-verifiable against a target snapshot. Unlike prior template-based approaches, our method leverages topology-aware synthesis to generate multi-constraint compositional questions with unique answers guaranteed via SPARQL validation. Evaluating 1,000 questions across three difficulty levels on both open-weight and frontier models, we expose a pronounced Recency Gap on facts that post-date a model’s training cutoff, particularly for compositional queries; retrieval dependence is thus an empirical property we measure, not a formal guarantee we claim. Through Oracle and Wikidata-as-corpus analyses, we disentangle dual failure modes: retrieval coverage limitations for single-hop questions and reasoning failures for compositional queries even with ground-truth evidence. LiveSearchBench provides both a rigorous construction methodology and a continuously updatable testbed for evaluating evidence integration under evolving knowledge.