ReActR: Reasoning through Error-Activated Reflection for LLM Post-Training

Lina Sun


Abstract
Although Large Language Models (LLMs) have demonstrated substantial proficiency in reasoning, current approaches focus disproportionately on scaling correct training samples, underexploring the value of incorrect reasoning trajectories. Motivated by how humans learn from mistakes, we propose ReActR (Reasoning through Error-Activated Reflection), a framework that enhances reasoning by learning reflective behaviors from erroneous trajectories. Specifically, ReActR comprises data construction and training. First, we synthesize multi-turn erroneous reasoning dataset spanning diverse error types and difficult levels via self-generation and targeted error generation. Second, we enhance the model’s capabilities through Supervised Fine-Tuning (SFT) on synthesized data and then apply Group Relative Policy Optimization (GRPO) with multiple reward signals to further refine reasoning performance. Extensive experiments across five benchmarks and three LLMs demonstrate that ReActR effectively enhances reasoning performance. Notably, on Llama-3-8B, ReActR achieves an average improvement of 3.5% across the five datasets.
Anthology ID:
2026.acl-long.1993
Volume:
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
43017–43028
Language:
URL:
https://aclanthology.org/2026.acl-long.1993/
DOI:
10.18653/v1/2026.acl-long.1993
Bibkey:
Cite (ACL):
Lina Sun. 2026. ReActR: Reasoning through Error-Activated Reflection for LLM Post-Training. In Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 43017–43028, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
ReActR: Reasoning through Error-Activated Reflection for LLM Post-Training (Sun, ACL 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.acl-long.1993.pdf
Checklist:
 2026.acl-long.1993.checklist.pdf