Language Shapes Instruction Hierarchy Compliance in Multilingual LLMs

Jiwon Moon, Yerin Hwang, Kyomin Jung


Abstract
Instruction hierarchy (IH) requires models to prioritize instructions by source, ensuring that higher-priority instructions override lower-priority ones. Despite its importance for safe and controllable deployment, existing evaluations have focused almost exclusively on English, leaving it unclear whether IH compliance remains stable in multilingual settings. We introduce XIH-Bench, a benchmark for multilingual IH evaluation with both same-language and cross-language conflicts across six languages, four domains, and three IH settings. Across models, we find two consistent patterns. First, IH compliance exhibits a clear language-dependent asymmetry: a language that strengthens compliance in the higher-priority position can become disruptive in the lower-priority position. Second, cross-language conflicts yield higher compliance than same-language conflicts, a phenomenon we term the Language Boundary Effect. We further show that language specialization can make lower-priority instructions in model-favored languages harder to override, creating multilingual reliability and security risks.
Anthology ID:
2026.emnlp-main.2153
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
48968–49004
Language:
URL:
https://aclanthology.org/2026.emnlp-main.2153/
DOI:
Bibkey:
Cite (ACL):
Jiwon Moon, Yerin Hwang, and Kyomin Jung. 2026. Language Shapes Instruction Hierarchy Compliance in Multilingual LLMs. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 48968–49004, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Language Shapes Instruction Hierarchy Compliance in Multilingual LLMs (Moon et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.2153.pdf