Ziwei Wang
Author directoryOther people with similar names: Ziwei Wang, Ziwei Wang
Unverified author pages with similar names: Ziwei Wang
2026
Superficial Reflection or Genuine Thought? A Fine-Grained Cognitive Analysis of Large Reasoning Models
Yuxiang Chen | Zuohan Wu | Ziwei Wang | Xiangning Yu | Xujia Li | Linyi Yang | Mengyue Yang | Jun Wang | Lei Chen
Findings of the Association for Computational Linguistics: IJCNLP-AACL 2026
Yuxiang Chen | Zuohan Wu | Ziwei Wang | Xiangning Yu | Xujia Li | Linyi Yang | Mengyue Yang | Jun Wang | Lei Chen
Findings of the Association for Computational Linguistics: IJCNLP-AACL 2026
Motivated by the observed human-like behaviours in Large Reasoning Models (LRMs), this paper introduces a comprehensive taxonomy to characterise atomic reasoning steps and analyse the reasoning behaviours of LRMs. Grounded in human cognitive processes, we propose a taxonomy comprising five groups and seventeen categories. Through this taxonomy, we conduct an in-depth analysis of contemporary LRMs and distil four actionable takeaways for model optimisation. Most notably, we reveal that prevailing post-answer “double-checks” are largely superficial and rarely yield substantive revisions. A targeted intervention further shows that explicitly eliciting richer reflection processes can substantially improve failed self-correction. To support this large-scale study, we propose CAPO, an automated annotation method used to construct a dataset of 277,534 reasoning steps with strong agreement with human expert annotations. We further validate the main behavioural patterns on a newer reasoning model and a coding domain, demonstrating the broader applicability of the proposed taxonomy. All source code and data are available at https://github.com/hehepig4/psyche.