SCAFFOLD: Self-Improving Web Agents via Recursive Parametric Skill Abstraction

Bowei He, Xiaokun Zhang, Meng Ding, Xue Liu


Abstract
Web agents need to navigate visually rich, long-horizon interfaces that change across sites, yet most previous agents still learn each task in isolation and discard the procedural knowledge they accumulate. Recent skill-augmented frameworks take an important first step, but they treat the skill library as a flat or two-tier prompt-side cache and offer no principled mechanism for compressing redundancy or composing skills recursively. We introduce Scaffold, a self-improving framework for visual web agents that (i) induces parametric, executable skills from successful trajectories under a multi-instance abstraction constraint, (ii) maintains a recursively composed hierarchy in which higher-level skills invoke lower-level ones, (iii) compacts the library via a minimum-description-length (MDL) criterion and behavioral equivalence checking, and (iv) periodically distills skill-augmented trajectories back into model weights to internalize the abstractions. Across WebArena, VisualWebArena, and a held-out split of Online-Mind2Web, Scaffold improves success rate by 11.1–17.2 absolute points over the strongest skill-augmented baseline and shows monotonic gains across five self-improvement iterations without library collapse. We release the code and documents in the Github [repository](https://github.com/BokwaiHo/SCAFFOLD).
Anthology ID:
2026.findings-emnlp.787
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
16634–16650
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.787/
DOI:
Bibkey:
Cite (ACL):
Bowei He, Xiaokun Zhang, Meng Ding, and Xue Liu. 2026. SCAFFOLD: Self-Improving Web Agents via Recursive Parametric Skill Abstraction. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 16634–16650, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
SCAFFOLD: Self-Improving Web Agents via Recursive Parametric Skill Abstraction (He et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.787.pdf