Seockbean Song
Author directory2026
Confidence-Gated Transductive Test Generation for Code Reranking
Sungjae Lee | Youngsik Yoon | Seockbean Song | Siwei Wang | Wei Chen | Jungseul Ok
Findings of the Association for Computational Linguistics: EMNLP 2026
Sungjae Lee | Youngsik Yoon | Seockbean Song | Siwei Wang | Wei Chen | Jungseul Ok
Findings of the Association for Computational Linguistics: EMNLP 2026
Test case synthesis is crucial for evaluating and ranking programs generated by large language models (LLMs). However, constructing high-quality test cases remains challenging because reliable expected outputs are often difficult to obtain. We propose Confidence-Gated Transductive Test Generation (CoTT), which first uses an efficient inductive procedure and invokes transductive generation only when inductive confidence is low. This adaptive design improves output reliability while allocating extra computation only when needed. On code reranking benchmarks, CoTT outperforms prior baselines across the reported metrics while reducing cost relative to applying transductive generation to every input. These results show that confidence-based allocation of test-time computation provides a favorable efficiency-effectiveness trade-off with a single efficient LLM.
PaT: Planning-after-Trial for Efficient Test-Time Code Generation
Youngsik Yoon | Sungjae Lee | Seockbean Song | Siwei Wang | Wei Chen | Jungseul Ok
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Youngsik Yoon | Sungjae Lee | Seockbean Song | Siwei Wang | Wei Chen | Jungseul Ok
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Beyond training-time optimization, scaling test-time computation has emerged as a key paradigm to extend the reasoning capabilities of Large Language Models (LLMs). However, most existing methods adopt a rigid Planning-before-Trial (PbT) policy, which inefficiently allocates test-time compute by incurring planning overhead even on directly solvable problems. We propose Planning-after-Trial (PaT), an adaptive policy for code generation that invokes a planner only upon verification failure. This adaptive policy naturally enables a heterogeneous model configuration: a cost-efficient model handles generation attempts, while a powerful model is reserved for targeted planning interventions. Empirically, across multiple benchmarks and model families, our approach significantly advances the cost-performance Pareto frontier. Notably, our heterogeneous configuration achieves performance comparable to a large homogeneous model while reducing inference cost by approximately 69%.