Folding Context into Executable States: Structured Strategy Folding for Long-Horizon Reasoning Agent

Zhengyu Chen, Luan Zhang, Zhaoyi Li, Jinluan Yang, Zheqi Lv, Teng Xiao, Wei Wang, Jingang Wang


Abstract
Current Large Language Model (LLM) agents struggle with long-horizon reasoning tasks, such as competition-level mathematics, where sustaining precision over hundreds of steps is critical. A primary bottleneck is the reliance on natural language context or summaries to track progress; these linguistic representations are inherently "lossy," introducing semantic drift and accumulating errors that derail the reasoning chain. To address this, we propose Structured Strategy Folding (SSF), a novel paradigm that shifts the agent’s memory mechanism from linguistic description to computational verification. Instead of compressing history into text, SSF "folds" the reasoning trajectory into a sequence of Executable Symbolic States (ESS). Each ESS serves as a verifiable anchor—comprising either executed code artifacts or formally judged symbolic lemmas—generated through a dual-pathway validation mechanism. By interacting with these rigorous state artifacts rather than raw textual history, the agent effectively eliminates ambiguity and prevents error propagation. Experiments on challenging mathematical benchmarks demonstrate that SSF significantly outperforms standard Chain-of-Thought and existing summarization baselines, achieving substantial accuracy improvements while maintaining robust performance over extended reasoning horizons.
Anthology ID:
2026.findings-emnlp.1331
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
28192–28209
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.1331/
DOI:
Bibkey:
Cite (ACL):
Zhengyu Chen, Luan Zhang, Zhaoyi Li, Jinluan Yang, Zheqi Lv, Teng Xiao, Wei Wang, and Jingang Wang. 2026. Folding Context into Executable States: Structured Strategy Folding for Long-Horizon Reasoning Agent. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 28192–28209, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Folding Context into Executable States: Structured Strategy Folding for Long-Horizon Reasoning Agent (Chen et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.1331.pdf