CAVD-Guard: Defending Against Token Fragmentation Jailbreaks via Attention Footprints

Junjie Xu, Zicheng Zhao


Abstract
Large language models remain vulnerable to jailbreaks that hide harmful intent from safety screening. A recent family of highly effective attacks exploits this weakness by splitting harmful keywords into recoverable fragments; we refer to this family as Token Fragmentation Jailbreaks. The success of these attacks stems from a mismatch between screening and generation: safety screening may no longer observe complete harmful keywords, while the target model can reconstruct them during generation. We show that instructions containing fragmented words leave a measurable attention footprint inside the model. Attention concentrates among the fragmented keyword pieces, while links from those pieces to complete words are weak. Based on this finding, we introduce Calibrated Attention-Void Detection (CAVD), a training-free detector that measures this footprint with length-conditioned calibration. We then combine guard models with CAVD in CAVD-Guard. When CAVD flags an instruction as unreliable for original-view safety screening, CAVD-Guard maps it to multiple canonical views and applies guard-based classification to the recovered views. Extensive experiments show that CAVD-Guard substantially reduces attack success and improves guard blocking while maintaining low false-positive rates on benign inputs. Code is available at https://github.com/serendipity098/CAVD-Guard.
Anthology ID:
2026.emnlp-main.1146
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
26254–26281
Language:
URL:
https://aclanthology.org/2026.emnlp-main.1146/
DOI:
Bibkey:
Cite (ACL):
Junjie Xu and Zicheng Zhao. 2026. CAVD-Guard: Defending Against Token Fragmentation Jailbreaks via Attention Footprints. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 26254–26281, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
CAVD-Guard: Defending Against Token Fragmentation Jailbreaks via Attention Footprints (Xu & Zhao, EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.1146.pdf