No Training, No Architecture Change: Per-Cell Warm-Up Calibration for LLM Agent Memory

Wenwen Liao, Yuansong Wang


Abstract
LLM agent memory modules universally adopt a single global retrieval depth k across all deployment scenarios; this global constraint produces an irreducible Oracle performance gap. We carry out a systematic evaluation on 19 heterogeneous deployment cells covering three LLM backbones, three multi-agent coordinators, three tasks, and two representative memory architectures (A-Mem and G-Memory). We confirm that the per-cell optimal k varies dramatically across cells, that low-capacity LLMs exhibit catastrophic accuracy collapse at larger k , and that no cross-cell feature or lookup-table shortcut reliably predicts the per-cell optimum. A theoretical analysis further shows that in the small-budget paired-binary-reward regime, every training-free bandit method we evaluate reduces to uniform-mean argmax. Motivated by this collapse, we propose per-cell warmup calibration: paired probe queries iteratively estimate the mean reward of each candidate k, the procedure commits to the empirical argmax, and a closed-form (2 σ) criterion provides earlystop. The recipe is training-free, requires no architectural modification, and introduces no hyperparameter beyond the probe budget. On all 19 deployment cells it attains 100% of the per-cell Oracle, with an average absolute improvement of +3.33 percentage points and a peak gain of +12.00 percentage points.
Anthology ID:
2026.emnlp-main.1957
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
44556–44575
Language:
URL:
https://aclanthology.org/2026.emnlp-main.1957/
DOI:
Bibkey:
Cite (ACL):
Wenwen Liao and Yuansong Wang. 2026. No Training, No Architecture Change: Per-Cell Warm-Up Calibration for LLM Agent Memory. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 44556–44575, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
No Training, No Architecture Change: Per-Cell Warm-Up Calibration for LLM Agent Memory (Liao & Wang, EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.1957.pdf