Mitigating LLM Over-Refusal via Dynamic Semantic Routing Calibration

Zixuan Wang, Bingjie Zhang, He Zhao, Dandan Guo


Abstract
Large language models (LLMs) aligned for safety often suffer from over-refusal, incorrectly rejecting benign yet safety-related instructions. Prior studies primarily attribute this to static representation overlap, largely overlooking the underlying dynamic mechanisms. In this paper, we present the mechanistic analysis of over-refusal through the lens of internal routing conflicts within transformer attention. We discover that a sparse subset of Hypersensitive Safety Heads misfires on Hard-Safe prompts, exhibiting abnormal attention entanglement that forcefully binds harmless target entities to refusal semantics. This triggers a severe, high-entropy routing conflict that deprives target entities of necessary attention. To counteract this, we propose Semantic Routing Calibration (SRC), a lightweight, training-free inference framework. SRC precisely localizes and dynamically suppresses these hypersensitive safety heads at the inference stage. Coupled with a dual-branch logits fusion that acts as a safety regularizer during subsequent decoding, SRC seamlessly restores trustworthy reasoning. Extensive experiments demonstrate that SRC alleviates over-refusal, with intrinsic safety performance preserved as much as feasible.
Anthology ID:
2026.emnlp-main.1413
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
32266–32288
Language:
URL:
https://aclanthology.org/2026.emnlp-main.1413/
DOI:
Bibkey:
Cite (ACL):
Zixuan Wang, Bingjie Zhang, He Zhao, and Dandan Guo. 2026. Mitigating LLM Over-Refusal via Dynamic Semantic Routing Calibration. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 32266–32288, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Mitigating LLM Over-Refusal via Dynamic Semantic Routing Calibration (Wang et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.1413.pdf