LongMem-RAT: Long-Term Memory for Cross-Session Red Teaming

Nurit Cohen Inger, Barak Haziz, Seffi Cohen, Yonatan Diga, Barak Chizi, Lior Rokach, Bracha Shapira


Abstract
Red-teaming has become a standard tool for probing alignment and safety weaknesses in large language models, but most existing methods treat each attack session in isolation and discard what was learned once the dialogue ends. We introduce **LongMem-RAT**, a multi-agent red-teaming framework equipped with long-term memory that accumulates, consolidates, and reuses insights from past attacks across sessions. This design enables cross-session generalization, reduces redundant exploration, and focuses new attacks on fragile alignment behaviors. Across multiple proprietary and open-weight models, LongMem-RAT improves Attack Success Rate (ASR) over a fully reproduced X-Teaming baseline by **21.73 percentage points on HarmBench and 18.40 points on AdvBench** (20.06 points on average). Memory ablations show that long-term memory improves ASR by 13.23 and 6.07 points and reduces Average Turns to Success (ATtS) by 0.37 and 1.92 turns on HarmBench and AdvBench, respectively, averaging a 9.65-point ASR gain and a 1.14-turn ATtS reduction.
Anthology ID:
2026.findings-emnlp.939
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
19798–19815
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.939/
DOI:
10.18653/2026.findings-emnlp.939
Bibkey:
Cite (ACL):
Nurit Cohen Inger, Barak Haziz, Seffi Cohen, Yonatan Diga, Barak Chizi, Lior Rokach, and Bracha Shapira. 2026. LongMem-RAT: Long-Term Memory for Cross-Session Red Teaming. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 19798–19815, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
LongMem-RAT: Long-Term Memory for Cross-Session Red Teaming (Inger et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.939.pdf