Q-Align: Query-Boundary Multilingual Alignment for LLM Safety Guardrails

Jiaqi Weng, Meizhen Liu, Xu Guo, Junyu Lin, Jinfeng Li, Jialing Tao, YueFeng Chen, Hui Xue


Abstract
Multilingual safety guardrails are essential for deployed LLMs, yet they perform poorly on low-resource languages. Prior work typically relies on large-scale multilingual safety data synthesis, which incurs substantial training costs. Cross-lingual transfer offers a cheaper alternative using limited parallel data, and recent work shows that aligning only last-token hidden states can improve multilingual safety. However, although effective for query-only (Q) risk detection, last-token alignment consistently degrades query-response (QR) detection in multilingual settings, limiting its applicability in practical guardrail systems where Q and QR serve as pre-generation and post-generation safety barriers, respectively. In this paper, we propose Q-Align, a method that decouples query intent from response evaluation by aligning only at the query boundary. Specifically, for each parallel sample, Q-Align extracts the hidden state right after the query and aligns multilingual query representations toward a confidence-weighted anchor, allowing languages with stronger intent understanding to guide transfer. We further apply language grouping based on geographic proximity to stabilize cross-lingual alignment. Experiments demonstrate that Q-Align consistently improves multilingual safety detection in both Q and QR scenarios, raising QR average F1 from 74.70% to 80.79% on Polyguard-Qwen, while preserving English performance and generalizing to languages unseen during training.
Anthology ID:
2026.emnlp-main.240
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
5484–5498
Language:
URL:
https://aclanthology.org/2026.emnlp-main.240/
DOI:
Bibkey:
Cite (ACL):
Jiaqi Weng, Meizhen Liu, Xu Guo, Junyu Lin, Jinfeng Li, Jialing Tao, YueFeng Chen, and Hui Xue. 2026. Q-Align: Query-Boundary Multilingual Alignment for LLM Safety Guardrails. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 5484–5498, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Q-Align: Query-Boundary Multilingual Alignment for LLM Safety Guardrails (Weng et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.240.pdf