Debargha Ganguly
Author directory2026
Mid-Think: Training-Free Intermediate-Budget Reasoning via Token-Level Triggers
Van Yang | Shouren Wang | Debargha Ganguly | Xinpeng Li | Chaoda Song | Vikash Singh | Vipin Chaudhary | Xiaotian Han
Findings of the Association for Computational Linguistics: ACL 2026
Van Yang | Shouren Wang | Debargha Ganguly | Xinpeng Li | Chaoda Song | Vikash Singh | Vipin Chaudhary | Xiaotian Han
Findings of the Association for Computational Linguistics: ACL 2026
Reasoning language models are controlled through explicit modes such as Think and No-think, yet we find that these behaviors are largely governed by a few token-level triggers rather than high-level instructions. Through attention analysis and controlled prompting experiments, we show that a leading “Okay” token induces reasoning behavior, while the newline pattern following ‘</think>‘ suppresses it. Based on this observation, we propose Mid-Think, a simple training-free prompting format that combines these triggers to achieve intermediate-budget reasoning, consistently outperforming fixed-token and prompt-based baselines in terms of the accuracy–length trade-off. Furthermore, applying Mid-Think to RL training after SFT reduces training time by approximately 15% while improving final performance of Qwen3-8B on AIME from 69.8% to 72.4% and on GPQA from 58.5% to 61.1%, demonstrating its effectiveness for both inference-time control and RL-based reasoning training.
Demystifying Hybrid Thinking: Can LLMs Truly Switch Between Think and No-Think?
Shouren Wang | Wang Yang | Xianxuan Long | Debargha Ganguly | Qifan Wang | Vipin Chaudhary | Xiaotian Han
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Shouren Wang | Wang Yang | Xianxuan Long | Debargha Ganguly | Qifan Wang | Vipin Chaudhary | Xiaotian Han
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Hybrid thinking enables LLMs to switch between reasoning and direct answering, offering a balance between efficiency and reasoning capability. Yet our experiments reveal that current hybrid thinking LLMs only achieve partial mode separation: reasoning behaviors often leak into the no-think mode. To understand and mitigate this, we analyze the factors influencing controllability and identify four that matter most: (1) larger data scale, (2) using think and no-think answers from different questions rather than the same question, (3) a moderate increase in no-think data number, and (4) a two-phase strategy that first trains reasoning ability and then applies hybrid think training. Building on these findings, we propose a practical recipe that, compared to standard training, can maintain accuracy in both modes while significantly reducing no-think output length (from 1085 to 585 on MATH500) and occurrences of reasoning-supportive tokens such as "wait" (from 5917 to 522 on MATH500). Our findings highlight the limitations of current hybrid thinking and point the ways for enhancing its controllability.