Qing Cui
Author directory2026
Robust Code RL via Faulty-Code-Driven Test case Synthesis and Dense Reward Shaping
Yiwen Zhang | Xiaodong Yan | Zhenyu Huang | Deng Zhao | Liang Jiang | Qing Cui | Zujie Wen | Zhiqiang Zhang | Jun Zhou
Findings of the Association for Computational Linguistics: EMNLP 2026
Yiwen Zhang | Xiaodong Yan | Zhenyu Huang | Deng Zhao | Liang Jiang | Qing Cui | Zujie Wen | Zhiqiang Zhang | Jun Zhou
Findings of the Association for Computational Linguistics: EMNLP 2026
Reinforcement Learning from Verifiable Rewards (RLVR) is pivotal for enhancing LLM code generation, yet its efficacy is often hindered by insufficient test case coverage, leading to reward hacking and policy degradation. To address this, we propose RobustTests, a framework featuring a faulty-code-driven test case synthesis strategy. By leveraging "near-correct" faulty codes, RobustTests captures latent logical discrepancies and employs validator agents with behavioral feature clustering to filter invalid or redundant test cases. Additionally, a stepwise dense reward function based on pass rates is introduced to mitigate false negatives and enhance training robustness. Using this pipeline, we construct an augmented version of the CodeContests+ dataset with superior diagnostic utility. Experimental results show that RL fine-tuning of Qwen3-32B via RobustTests achieves a 3% absolute gain on LiveCodeBench, demonstrating its effectiveness in advancing LLM code generation proficiency. Codes and data are available at https://huggingface.co/datasets/sid6/RobustTests.
UniGeM: Unifying Data Selection and Mixing via Geometric Exploration and Mining
Changhao Wang | Yunfeiyu | Xinhao Yao | Jiaolong Yang | Lu Yu | Junpeng Fang | Chaobo Li | Riccardo Cantoro | Qing Cui | Jun Zhou
Findings of the Association for Computational Linguistics: ACL 2026
Changhao Wang | Yunfeiyu | Xinhao Yao | Jiaolong Yang | Lu Yu | Junpeng Fang | Chaobo Li | Riccardo Cantoro | Qing Cui | Jun Zhou
Findings of the Association for Computational Linguistics: ACL 2026
The scaling of Large Language Models (LLMs) is increasingly limited by data quality. Most methods handle data mixing and sample selection separately, which can break the structure in code corpora. We introduce UniGeM, a framework that unifies mixing and selection by treating data curation as a manifold approximation problem without training proxy models or relying on external reference datasets. UniGeM operates hierarchically: Macro-Exploration learns mixing weights with stability-based clustering; Micro-Mining filters high-quality instances by their geometric distribution to ensure logical consistency. Validated by training 8B and 16B MoE models on 100B tokens, UniGeM achieves 2.0 × data efficiency over a random baseline and further improves overall performance compared to SOTA methods in reasoning-heavy evaluations and multilingual generalization.
Improving Autoformalization Using Direct Dependency Retrieval
Shaoqi Wang | Lu Yu | Siwei Lou | Feng Yan | Chunjie Yang | Qing Cui | Jun Zhou
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Shaoqi Wang | Lu Yu | Siwei Lou | Feng Yan | Chunjie Yang | Qing Cui | Jun Zhou
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Statement autoformalization, a crucial first step in formal verification, aims to transform informal descriptions of math problems into machine-verifiable formal representations but remains a significant challenge. The core difficulty lies in the fact that existing language models hallucinate formal dependencies, including missing or incorrect definitions, lemmas, and theorems. Current dependency retrieval approaches exhibit poor precision and recall, and lack the scalability to leverage ever-growing public datasets. To bridge this gap, we propose a novel retrieval-augmented framework based on Direct Dependency Retrieval (DDR). DDR directly generates candidate formal dependencies from natural-language mathematical descriptions and verifies their existence in the formal library via an efficient Suffix Array Check (SAC). Built on a SAC-constructed dependency retrieval dataset of over 500,000 samples, a high-precision DDR model is fine-tuned and shown to significantly outperform state-of-the-art methods in both retrieval precision and recall, leading to superior advantage in the autoformalization tasks. SAC also contributes in assessing formalization difficulty and enabling explicit quantification of the hallucination in In-Context Learning (ICL).