Kehan Jiang
Author directory2026
How Order-Sensitive Are LLMs? OrderProbe for Deterministic Structural Reconstruction
Zhaolu Kang | Yingjie He | Kehan Jiang | Leqi Zheng | Jiachen Qian | Qianyuan Zhang | Chunlei Meng | Yujie Feng | Yuan Wang | Stephen Dou | Aming Wu | Pengxiang Zhao | Jiaxin Liu | Guansu Wang | Zeyu Zhang | Zeyu Wang | Lei Wang | Qishi Zhan | Xiaomin He | Meisheng Zhang | Jianyuan Ni | Richeng Xuan
Findings of the Association for Computational Linguistics: EMNLP 2026
Zhaolu Kang | Yingjie He | Kehan Jiang | Leqi Zheng | Jiachen Qian | Qianyuan Zhang | Chunlei Meng | Yujie Feng | Yuan Wang | Stephen Dou | Aming Wu | Pengxiang Zhao | Jiaxin Liu | Guansu Wang | Zeyu Zhang | Zeyu Wang | Lei Wang | Qishi Zhan | Xiaomin He | Meisheng Zhang | Jianyuan Ni | Richeng Xuan
Findings of the Association for Computational Linguistics: EMNLP 2026
Large language models (LLMs) excel at semantic understanding, yet their ability to reconstruct internal structure from scrambled inputs remains underexplored. Sentence-level restoration is difficult to evaluate automatically because scrambled sentences often admit multiple valid reorderings. We introduce OrderProbe, a deterministic benchmark for structural reconstruction using fixed four-character expressions in Chinese, Japanese, and Korean, which have a unique canonical order and thus support exact-match scoring. We further propose a diagnostic framework that evaluates models beyond recovery accuracy, including Semantic Accuracy, Logical Validity, Structural Consistency, Robustness, and Information Density. Experiments on twelve widely used LLMs show that structural reconstruction remains difficult even for frontier systems: zero-shot recovery frequently falls below 35%. We also observe a consistent gap between meaning-oriented generation and exact structural reconstruction, suggesting that structural robustness is not an automatic byproduct of semantic competence.
FoE: Forest of Errors Makes the First Solution the Best in Large Reasoning Models
Kehan Jiang | Haonan Dong | Zhaolu Kang | Zhengzhou Zhu | Guojie Song
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Kehan Jiang | Haonan Dong | Zhaolu Kang | Zhengzhou Zhu | Guojie Song
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Recent Large Reasoning Models (LRMs) like DeepSeek-R1 have demonstrated remarkable success in complex reasoning tasks, exhibiting human-like patterns in exploring multiple alternative solutions. Upon closer inspection, however, we uncover a surprising phenomenon: The First is The Best, where alternative solutions are not merely suboptimal but potentially detrimental. This observation challenges widely accepted test-time scaling laws, leading us to hypothesize that errors within the reasoning path scale concurrently with test time. Through comprehensive empirical analysis, we characterize errors as a forest-structured Forest of Errors (FoE) and conclude that FoE makes the First the Best, which is underpinned by rigorous theoretical analysis. Leveraging these insights, we propose RED, a self-guided efficient reasoning framework comprising two components: I) Refining First, which suppresses FoE growth in the first solution; and II) Discarding Subs, which prunes subsequent FoE via dual-consistency. Extensive experiments across five benchmarks and six backbone models demonstrate that RED outperforms eight competitive baselines, achieving performance gains of up to 19.0% while reducing token consumption by 37.7% 70.4%. Moreover, comparative experiments on FoE metrics shed light on how RED achieves effectiveness.
NeuReasoner: Towards Explainable, Controllable, and Unified Reasoning via Mixture-of-Neurons
Haonan Dong | Kehan Jiang | Haoran Ye | Wenhao Zhu | Zhaolu Kang | Guojie Song
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Haonan Dong | Kehan Jiang | Haoran Ye | Wenhao Zhu | Zhaolu Kang | Guojie Song
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Large Reasoning Models (LRMs) have recently achieved remarkable success in complex reasoning tasks. However, closer scrutiny reveals persistent failure modes compromising performance and cost: I) Intra-step level, marked by calculation or derivation errors; II) Inter-step level, involving oscillation and stagnation; and III) Instance level, causing maladaptive over-thinking. Existing endeavors target isolated levels without unification, while their black-box nature and reliance on RL hinder explainability and controllability. To bridge these gaps, we conduct an in-depth white-box analysis, identifying key neurons (Mixture of Neurons, MoN) and their fluctuation patterns associated with distinct failures. Building upon these insights, we propose NeuReasoner, an explainable, controllable, and unified reasoning framework driven by MoN. Technically, NeuReasoner integrates lightweight MLPs for failure detection with a special token-triggered self-correction mechanism learned via SFT. During inference, special tokens are inserted upon failure detection to actuate controllable remedial behaviors. Extensive evaluations across six benchmarks, six backbone models (8B 70B) against nine competitive baselines, demonstrate that NeuReasoner achieves performance gains of up to 27.0% while reducing token consumption by 19.6% 63.3%.