Beyond Planning: Sparse Context Reset for Long-Horizon GUI Agents

Weiyao Huang, Xinye Wu, Zeming Liu, Xiaoyu Shen, Yunpu Ma


Abstract
Graphical User Interface (GUI) agents powered by vision-language models (VLMs) have emerged as a promising paradigm for computer-use automation, but remain unreliable on long-horizon tasks. Existing planner–executor frameworks address this by shifting more reasoning to the planner, thereby decomposing rather than decoupling long-horizon reasoning. Our failure analysis reveals that many long-horizon failures are not pure capability gaps: from the same failure state, executors recover substantially more often when their accumulated context is reset with a locally executable subtask. To bridge this gap, we propose SCoR, a sparse context reset framework that restores the executor’s short-horizon capability by resetting its accumulated task context. At subtask boundaries, a lightweight Refiner emits a locally executable subtask and resets the Executor’s context; the executor then autonomously executes multiple GUI actions within the reset context. We train the Refiner with turn-level GRPO. In OSWorld, SCoR achieves a success rate of 53.16%, yielding a 25.41% relative improvement over the standalone EvoCUA-8B executor. Our code is available at https://github.com/huia711/SCoR.
Anthology ID:
2026.emnlp-main.1634
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
37145–37163
Language:
URL:
https://aclanthology.org/2026.emnlp-main.1634/
DOI:
Bibkey:
Cite (ACL):
Weiyao Huang, Xinye Wu, Zeming Liu, Xiaoyu Shen, and Yunpu Ma. 2026. Beyond Planning: Sparse Context Reset for Long-Horizon GUI Agents. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 37145–37163, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Beyond Planning: Sparse Context Reset for Long-Horizon GUI Agents (Huang et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.1634.pdf