STRETCH the Boundaries: A Unified Self-Taught Framework for Progressive LLM Evolution

Yajie Yu, Mark Lee, Yue Feng


Abstract
Large language models (LLMs) often suffer from capability stagnation in self-improvement training due to fixed difficulty levels. To address this issue, we propose STRETCH (Self-Taught Reasoning Evolution via Targeted CHallenge) inspired by cognitive scaffolding theory. STRETCH introduces a dynamic Stretch Zone mechanism that continuously aligns question difficulty with the model’s solving capability. Within a single parameter space, the model alternates between a Scaffolder that generates adaptive challenges and a Learner that solves them through reinforcement learning. This dual-loop co-evolution process stabilize training and promote progressive reasoning growth. Experiments on both negotiation and operation research benchmarks demonstrate that STRETCH consistently outperforms strong prompting and domain-specific baselines. Further analysis shows that dynamic difficulty alignment is critical for sustained capability improvement and synchronized reasoning evolution.
Anthology ID:
2026.findings-emnlp.1168
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
24732–24747
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.1168/
DOI:
Bibkey:
Cite (ACL):
Yajie Yu, Mark Lee, and Yue Feng. 2026. STRETCH the Boundaries: A Unified Self-Taught Framework for Progressive LLM Evolution. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 24732–24747, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
STRETCH the Boundaries: A Unified Self-Taught Framework for Progressive LLM Evolution (Yu et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.1168.pdf