Yuzhao Peng
Author directory2026
Why does Weak-OOD Help? A Further Step Towards Understanding Jailbreaking VLMs
Yuxuan Zhou | Yuzhao Peng | Yang Bai | Kuofeng Gao | Yihao Zhang | Yechao Zhang | Xun Chen | Tao Yu | Tao Dai | Shu-Tao Xia
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Yuxuan Zhou | Yuzhao Peng | Yang Bai | Kuofeng Gao | Yihao Zhang | Yechao Zhang | Xun Chen | Tao Yu | Tao Dai | Shu-Tao Xia
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Large Vision-Language Models (VLMs) are susceptible to jailbreak attacks: researchers have developed various attack strategies that bypass the safety mechanisms of VLMs. Among these approaches, jailbreak methods based on the Out-of-Distribution (OOD) strategy have garnered widespread attention due to their simplicity and effectiveness. This paper further advances the understanding of OOD-based VLM jailbreak methods. We show that mild OOD manipulations can achieve stronger jailbreak performance than both clean inputs and overly strong perturbations, a non-monotonic pattern we define as "weak-OOD". We explain this phenomenon through a trade-off between two dominant factors: input intent perception and model refusal triggering. Our evidence suggests that these two factors respond differently to OOD manipulations, which is consistent with a discrepancy between broad pre-training robustness and narrower safety alignment. Building on this insight, we draw inspiration from optical character recognition (OCR) capability enhancement, a core task in the pre-training phase of mainstream VLMs. Leveraging this capability, we design JOCR (Jailbreak via OCR-Aware Embedded Text Perturbation), a simple VLM jailbreak method that achieves the best average ASR among evaluated baselines.