SEDIMA: Cross-Run Hierarchical Insight Memory for Evolutionary Search Agents

Amirhossein Abaskohi, Mahdi Mostajabdaveh, Zirui Zhou


Abstract
Large language model (LLM)-driven evolutionary search is a powerful paradigm for automated program and algorithm discovery, yet existing systems are largely memoryless: each run explores from scratch, so agents repeatedly rediscover the same improvements and re-encounter the same dead ends. We introduce SEDIMA, a persistent hierarchical insight memory for evolutionary search agents. SEDIMA distills raw traces into natural-language insights, clusters them by semantic similarity using attention-weighted centroids, and retrieves relevant guidance to condition future mutations, accumulating transferable knowledge across runs and problems rather than within a single trajectory. As a drop-in module that leaves the search operators unmodified, SEDIMA improves average final performance by 5.5% on AlgoTune and 6.6% on ALE-Bench LITE under a fixed budget of 100 evaluated candidates. Under OpenEvolve, SEDIMA requires 32.3% fewer iterations on average to reach baseline-best performance across the five evaluated backbones.
Anthology ID:
2026.realm-1.62
Volume:
Proceedings of the Second Workshop for REsearch on Agent Language Models (REALM 2026)
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Ehsan Kamalloo, Nicolas Gontier, Nikolai Rozanov, Maryam Hashemzadeh, Akhil Arora
Venues:
REALM | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
903–921
Language:
URL:
https://aclanthology.org/2026.realm-1.62/
DOI:
Bibkey:
Cite (ACL):
Amirhossein Abaskohi, Mahdi Mostajabdaveh, and Zirui Zhou. 2026. SEDIMA: Cross-Run Hierarchical Insight Memory for Evolutionary Search Agents. In Proceedings of the Second Workshop for REsearch on Agent Language Models (REALM 2026), pages 903–921, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
SEDIMA: Cross-Run Hierarchical Insight Memory for Evolutionary Search Agents (Abaskohi et al., REALM 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.realm-1.62.pdf