LogitsCoder: Towards Efficient Chain-of-Thought Path Search via Logits Preference Decoding for Code Generation

Jizheng Chen, Weiming Zhang, Xinyi Dai, Lingyue Fu, Weiwen Liu, Kounianhua Du, Qingyao Li, Yong Yu, Weinan Zhang


Abstract
Code generation requires executable reasoning, making test-time chain-of-thought (CoT) search an attractive strategy for improving solution quality. However, existing CoT scaling methods often face a tension between underthinking, where shallow reasoning misses important algorithmic cases, and overthinking, where verbose or redundant reasoning consumes substantial tokens without improving correctness. We propose LogitsCoder, a lightweight framework that revisits CoT search from the perspective of logits-level control. LogitsCoder improves efficient reasoning search through two complementary mechanisms: Logits Preference Decoding adaptively calibrates local token expansion using public-test feedback, while Logits Rank Based Path Selection explores and selects compact high-confidence reasoning trajectories based on logit-level stability. Together with Thoughts Aggregation, LogitsCoder refines reasoning paths without relying on costly MCTS-style tree expansion. Extensive experiments demonstrate that LogitsCoder produces more efficient and higher-quality reasoning chains, leading to superior code generation performance compared to baseline methods.
Anthology ID:
2026.findings-emnlp.1527
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
32495–32510
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.1527/
DOI:
Bibkey:
Cite (ACL):
Jizheng Chen, Weiming Zhang, Xinyi Dai, Lingyue Fu, Weiwen Liu, Kounianhua Du, Qingyao Li, Yong Yu, and Weinan Zhang. 2026. LogitsCoder: Towards Efficient Chain-of-Thought Path Search via Logits Preference Decoding for Code Generation. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 32495–32510, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
LogitsCoder: Towards Efficient Chain-of-Thought Path Search via Logits Preference Decoding for Code Generation (Chen et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.1527.pdf