Code-TVT: Synthesizing Test-Case-Driven Verifiable Tasks for Code Reinforcement Learning

Jin Jiang, Junlong Zhang, Yuchen Yan, Zhaoze, Changzhi Zhou, Suncong Zheng, Liangcai Gao


Abstract
Verifiers play a central role in large language model reasoning by providing reliable supervision for post-training methods such as reinforcement learning. In code generation, however, verification is still predominantly based on fixed test cases, offering a narrow but underexploited form of verifiable supervision. We explore how existing test cases can be reformulated into more diverse and challenging sources of verifiable training signals. We propose Code-TVT (Test-Case-Driven Verifiable Tasks), a data synthesis framework that transforms program test cases into intrinsically verifiable code reasoning tasks. Using test cases already available in programming problems, we design two complementary tasks: Edge Test-Case Generation, which constructs edge-case inputs that expose subtle correctness failures, and Input Reconstruction via Program Output Inversion, which reasons backward from outputs to plausible inputs under execution-based verification. Experiments show that training with Code-TVT consistently improves code generation performance on three time-windowed LiveCodeBench splits (LCB-2408-2411, LCB-V5, and LCB-V6) under rejection-sampling fine-tuning and Group Relative Policy Optimization.
Anthology ID:
2026.emnlp-main.1574
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
35842–35865
Language:
URL:
https://aclanthology.org/2026.emnlp-main.1574/
DOI:
Bibkey:
Cite (ACL):
Jin Jiang, Junlong Zhang, Yuchen Yan, Zhaoze, Changzhi Zhou, Suncong Zheng, and Liangcai Gao. 2026. Code-TVT: Synthesizing Test-Case-Driven Verifiable Tasks for Code Reinforcement Learning. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 35842–35865, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Code-TVT: Synthesizing Test-Case-Driven Verifiable Tasks for Code Reinforcement Learning (Jiang et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.1574.pdf