Know When to Reflect: Entropy-Guided Adaptive Self-Correction for LLM Reasoning

Xinglei Hao, Haiyu Zhao, Chunhong Zhang, Liping Liu, Jiarun Liu, Zheng Hu


Abstract
Self-correction has emerged as a promising paradigm for enhancing LLM reasoning, yet recent studies reveal a troubling phenomenon: without external oracle feedback, iterative reflection often degrades rather than improves performance. Our analysis uncovers that toxic reflection, where correct answers deteriorate into incorrect ones, occurs at rates comparable to effective corrections. We identify the root cause as the shortsightedness of existing methods: models focus only on the previous output while neglecting the global reasoning state, rendering them unable to quantify uncertainty. To address this, we propose two complementary reflection signals — Reflecting Entropy for snapshot disagreement among reasoning trajectories and Belief Shift for inter-round belief revision — paired with a two-stage hierarchical controller that schedules reflection adaptively. We instantiate these ideas as REGAR (Reflecting Entropy-Guided Adaptive Reflection), a framework that maintains a pool of candidate reasoning trajectories and applies a single, uniform reflection primitive when correction is needed. Experiments on mathematical and commonsense reasoning demonstrate consistent improvements over strong baselines while reducing computational overhead, highlighting both effectiveness and efficiency.
Anthology ID:
2026.findings-emnlp.805
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
17056–17077
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.805/
DOI:
10.18653/2026.findings-emnlp.805
Bibkey:
Cite (ACL):
Xinglei Hao, Haiyu Zhao, Chunhong Zhang, Liping Liu, Jiarun Liu, and Zheng Hu. 2026. Know When to Reflect: Entropy-Guided Adaptive Self-Correction for LLM Reasoning. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 17056–17077, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Know When to Reflect: Entropy-Guided Adaptive Self-Correction for LLM Reasoning (Hao et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.805.pdf