ReFrame: Evidence-Guided Test-Time Safety Alignment in Multimodal Large Language Models

Wenzheng Jiang, Xuankun Rong, Yuanzhao Zhai, Feng Dawei, Huaimin Wang


Abstract
While multimodal large language models (MLLMs) extend model capabilities beyond text, they also make safety alignment increasingly challenging. Multimodal safety alignment methods must address cross-modal jailbreaks, safety-awareness failures, and over-sensitive refusals. However, existing methods often rely on retraining or internal-state inspection, limiting their applicability to deployed closed-source MLLMs and motivating test-time safety alignment. We analyze this setting and identify two key obstacles, utility dominance and reasoning inertia, which cause models to overlook latent risks or follow malicious reasoning trajectories. Guided by these insights, we propose **ReFrame**, a training-free multimodal input reframing framework where two agents share a lightweight locally deployed MLLM: the evidence-generation agent constructs complementary risk and utility evidence, and the rewrite-and-routing agent converts it into a safe proxy prompt and image-routing decision before calling the downstream MLLM, without modifying it or accessing its internal information. Experiments across multiple MLLMs and benchmarks show that ReFrame improves jailbreak defense, safety awareness, and oversensitivity reduction while preserving multimodal utility.
Anthology ID:
2026.findings-emnlp.1179
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
24916–24936
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.1179/
DOI:
Bibkey:
Cite (ACL):
Wenzheng Jiang, Xuankun Rong, Yuanzhao Zhai, Feng Dawei, and Huaimin Wang. 2026. ReFrame: Evidence-Guided Test-Time Safety Alignment in Multimodal Large Language Models. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 24916–24936, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
ReFrame: Evidence-Guided Test-Time Safety Alignment in Multimodal Large Language Models (Jiang et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.1179.pdf