Bohan Liu
Author directory2026
Triggering Chain-of-Thought via Latent Feature Interventions in Large Language Models
Zhenghao He | Guangzhi Xiong | Bohan Liu | Sanchit Sinha | Aidong Zhang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Zhenghao He | Guangzhi Xiong | Bohan Liu | Sanchit Sinha | Aidong Zhang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Chain-of-Thought (CoT) prompting often improves the reasoning performance of large language models (LLMs), but the internal signal that triggers this behavior remains poorly understood. Leveraging the sparse features captured by Sparse Autoencoders (SAEs), we propose a systematic framework to analyze and intervene on the internal representations of LLMs, identifying a small set of latent features that are linked to reasoning behavior and can be causally tested through targeted intervention. Across multiple model families and reasoning benchmarks, we show that steering a single reasoning-related latent feature can substantially induce reasoning behavior without explicit CoT prompting, achieving accuracy comparable to CoT. We further show that the identified features are not tied to particular wording patterns or verbosity, and confirm their causal role in reasoning through suppression experiments that impair performance even under CoT prompting. These results suggest that CoT prompting activates specific latent features to trigger reasoning, and that targeted intervention on these features offers an alternative pathway to elicit efficient reasoning behavior without explicit CoT prompting.