Hourun Zhu

Author directory

2026

Large reasoning models achieve strong problem-solving performance, but often generate excessively long chain-of-thought outputs, which substantially increase inference cost and limit practical deployment. Existing reasoning compression methods reduce length only partially and often suffer from unstable optimization or accuracy degradation. We trace this limitation to an underlying trajectory-level objective conflict: when the compression objective and the accuracy objective are optimized jointly, compression favors short-and-correct trajectories while accuracy optimization continues to preserve long-but-correct ones that remain useful on hard problems. This conflict creates opposing gradients on the same behaviors and can trap training in a local trade-off where further compression harms accuracy while accuracy recovery reintroduces verbose reasoning. At the model-decision level, we refer to the resulting failure mode as entropy conflict: the policy fails to fully collapse onto concise trajectories because accuracy-oriented updates keep restoring broader support over long-correct reasoning paths. To address this issue, we propose an entropy-guided training framework. Instead of forcing a mixed objective to follow an unstable path toward the final efficient-output set, we first contract the policy to a short-output set and then expand from this compact regime to recover accuracy and robustness. Experiments on multiple mathematical reasoning benchmarks show that our method achieves performance comparable to the original model using only about 25% of its reasoning tokens.