Notes to Self: Can LLMs Benefit from Experiential Abstractions?

Chang Liu, Xinyu Li, Artur Dubrawski


Abstract
Humans distill experience into reusable abstractions, e.g., strategies and cautionary reminders, and apply them to gradually solve problems more effectively. We study whether Large Language Models (LLMs) can similarly benefit from such experiential abstractions. From LLMs’ solution traces on a training set, a stronger teacher or the LLMs themselves extract natural-language abstractions into a retrievable library. We explore two modes of abstraction usage: (1) inference-time retrieval and (2) reinforcement learning (RL) with abstraction-augmented training prompts. Experiential abstractions improve LLM performance on mathematical and logical reasoning benchmarks. Self-extracted abstractions match teacher-extracted ones, and our abstraction usage framework can transfer to other datasets and models. These findings suggest LLMs can extract and apply experiential abstractions much as humans leverage distilled experience.
Anthology ID:
2026.findings-emnlp.2050
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
43634–43645
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.2050/
DOI:
10.18653/2026.findings-emnlp.2050
Bibkey:
Cite (ACL):
Chang Liu, Xinyu Li, and Artur Dubrawski. 2026. Notes to Self: Can LLMs Benefit from Experiential Abstractions?. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 43634–43645, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Notes to Self: Can LLMs Benefit from Experiential Abstractions? (Liu et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.2050.pdf