From Trajectories to Workflows: Online Procedural Memory Abstraction for Language Agents

Swathi Shree Narashiman, Ishan Jindal, Mahesh Chandran


Abstract
Procedural memory for language agents typically accumulates as trajectories, scripts, or task-specific skills, so memory grows with the number of interactions rather than the number of distinct procedures learned. We propose a workflow-centric procedural memory framework that continually consolidates repeated experience into a bounded set of natural-language workflows. These workflows are merged online under outcome-conditioned update policies. On ALFWorld and ScienceWorld, our memory is competitive with trajectory-level procedural memory on task success while using 3.5× fewer memory tokens on average (1.1-9.1× across settings), showing that representation besides construction, retrieval and updating is also a key design axis for scalable procedural memory.
Anthology ID:
2026.realm-1.78
Volume:
Proceedings of the Second Workshop for REsearch on Agent Language Models (REALM 2026)
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Ehsan Kamalloo, Nicolas Gontier, Nikolai Rozanov, Maryam Hashemzadeh, Akhil Arora
Venues:
REALM | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1144–1159
Language:
URL:
https://aclanthology.org/2026.realm-1.78/
DOI:
Bibkey:
Cite (ACL):
Swathi Shree Narashiman, Ishan Jindal, and Mahesh Chandran. 2026. From Trajectories to Workflows: Online Procedural Memory Abstraction for Language Agents. In Proceedings of the Second Workshop for REsearch on Agent Language Models (REALM 2026), pages 1144–1159, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
From Trajectories to Workflows: Online Procedural Memory Abstraction for Language Agents (Narashiman et al., REALM 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.realm-1.78.pdf