Pag-refuse: Safety Alignment Transfers Unevenly to Tagalog and Taglish

Albrave Raphael Albayda, Angelica Anne Araneta Naguio


Abstract
Large language model safety training is concentrated in English. We test whether the resulting refusal behavior extends to Tagalog and Taglish, a Tagalog–English mixed register used in everyday conversation. We translate all 313 StrongREJECT prompts into both forms and evaluate 29 models from nine model providers, obtaining 27,042 responses. Seven models give jailbreak responses to more than 10% of Tagalog prompts whose English versions they answered safely; five exceed 20%, and one reaches 32.7%. For nine models, an exact McNemar test finds more jailbreak responses in Tagalog than in English (p<0.05), six of them after Bonferroni correction. Tagalog jailbreaks are concentrated in smaller models. Taglish prompts produce fewer jailbreaks than monolingual Tagalog prompts, contrasting with prior results from programmatically constructed code-switching.
Anthology ID:
2026.mrl-1.41
Volume:
Proceedings of the 6th Workshop on Multilingual Representation Learning (MRL 2026)
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
David Ifeoluwa Adelani, Jesujoba Alabi, Catherine Arnett, Tyler Chang, C.M. Downey, Omer Goldman, Senyu Li, Lester James Validad Miranda, Jirui Qi, David Stap, Genta Indra Winata, Xinyu Crystina Zhang
Venues:
MRL | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
510–518
Language:
URL:
https://aclanthology.org/2026.mrl-1.41/
DOI:
Bibkey:
Cite (ACL):
Albrave Raphael Albayda and Angelica Anne Araneta Naguio. 2026. Pag-refuse: Safety Alignment Transfers Unevenly to Tagalog and Taglish. In Proceedings of the 6th Workshop on Multilingual Representation Learning (MRL 2026), pages 510–518, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Pag-refuse: Safety Alignment Transfers Unevenly to Tagalog and Taglish (Albayda & Naguio, MRL 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.mrl-1.41.pdf