Endogenous Observations in Agent Self-Evolution: A Survey

Zhixin Zhang, Xinke Jiang, Jiaran Gao, Zhibang Yang, Yuheng Huang, Junfeng Zhao, Xu Chu, Yasha Wang


Abstract
As training regimes centered on human-curated data encounter rising costs and an increasingly binding scaling ceiling, a core question in agent learning shifts from enlarging exogenous datasets to enabling agents to **self-evolve** under limited exogenous supervision. Prior surveys on self-evolution and self-improvement typically organize the literature by evolutionary stages or system architectures. While effective for summarizing implementation pipelines, these perspectives do not offer a unified explanation of what an agent actually observes during self-improvement, nor why such signals can serve as sufficient and reliable supervision. To address this gap, we introduce **endogenous observations**, defined as learning signals that arise from an agent’s own generation, evaluation, and interaction processes rather than exogenous labels. We systematize existing approaches into three categories—model-internal, peer-induced, and scenario-grounded observations—according to how these signals are produced, and we summarize the characteristic properties and typical application settings of each category. Finally, we discuss key challenges in reliability, scalability, and long-horizon stability, and outline open directions toward robust and sustainable self-evolving agents.
Anthology ID:
2026.findings-emnlp.1196
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
25257–25276
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.1196/
DOI:
Bibkey:
Cite (ACL):
Zhixin Zhang, Xinke Jiang, Jiaran Gao, Zhibang Yang, Yuheng Huang, Junfeng Zhao, Xu Chu, and Yasha Wang. 2026. Endogenous Observations in Agent Self-Evolution: A Survey. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 25257–25276, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Endogenous Observations in Agent Self-Evolution: A Survey (Zhang et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.1196.pdf