ThinkLeap: Reasoning Optimization Through Confidence-Guided Cognitive Leap Extraction

Yijia Zhu, Zhenning Shi, Junhan Shi, Xun Zhang, Yong Jiang, Qing Li


Abstract
Large Reasoning Models (LRMs) show remarkable capabilities in complex reasoning tasks through Chain-of-Thought (CoT) mechanisms. However, their reasoning processes frequently suffer from overthinking, generating inefficient patterns and substantial overhead without improving quality. Existing pruning approaches typically rely on computationally expensive external teacher models or aggregated sequence-level metrics, failing to capture the fine-grained, intrinsic cognitive state of individual reasoning steps. In this paper, we propose ThinkLeap, a novel confidence-guided optimization framework that identifies and retains only critical cognitive leaps within reasoning chains. Our approach is grounded in the observation that a model’s internal confidence dynamics serve as a fine-grained structural signal: rising confidence often reflects evidence accumulation, while declining confidence signals doubt or redundancy. By leveraging these dynamics, ThinkLeap autonomously replaces inefficient steps with ellipsis markers, preserving the logical flow while signaling omitted deliberation. Extensive experiments across three challenging reasoning benchmarks demonstrate that ThinkLeap establishes a new paradigm for efficient reasoning, achieving an average 19.4% reduction in reasoning length while maintaining comparable accuracy.
Anthology ID:
2026.emnlp-main.2270
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
51628–51641
Language:
URL:
https://aclanthology.org/2026.emnlp-main.2270/
DOI:
Bibkey:
Cite (ACL):
Yijia Zhu, Zhenning Shi, Junhan Shi, Xun Zhang, Yong Jiang, and Qing Li. 2026. ThinkLeap: Reasoning Optimization Through Confidence-Guided Cognitive Leap Extraction. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 51628–51641, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
ThinkLeap: Reasoning Optimization Through Confidence-Guided Cognitive Leap Extraction (Zhu et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.2270.pdf