Do LLMs Transfer Political Framing across Languages? A Cross-Lingual Analysis of LLM-Generated Discourse

Nooredeen Awwad, Ebtihal Ismail Enfes, Kolawole John Adebayo


Abstract
As large language models (LLMs) increasingly mediate political information across linguistic contexts, concerns emerge regarding cross-lingual consistency in political framing. We investigate whether multilingual LLMs generate systematically different rhetorical and semantic frames when prompted in English versus Arabic on the politically salient issue of migration. Focusing on two widely used models, i.e., GPT-4o and Jais-13B, we implement a controlled prompt design (N = 800 generations; 400 per language), to isolate language as the primary experimental variable. We introduce a mixed method evaluation framework that combines lexical frame analysis, statistical association testing, and qualitative discourse analysis. Our results show a significant association between language and framing distribution (χ2 = 43.32, p = 2.11 × 10−9). While security-oriented framing is prominent in both languages, English generations exhibit substantially higher rates of institutional and legislative framing, whereas Arabic generations show greater concentration in security and communitarian discourse. These findings indicate that input language acts as a conditioning signal that systematically modulates political framing within multilingual LLMs, even under controlled semantic prompts. We conceptualize this phenomenon as cross-lingual framing drift and discuss its implications for multilingual alignment, political bias evaluation, and global information ecosystems. We conclude by outlining an evaluative protocol for detecting language-conditioned asymmetries in generative models. We make all data, code, and experimental settings publicly available at: https://github.com/NRAwwad/-A-Cross-Lingual-Analysis-of-Political-Framing-in-English-and-Arabic.git.
Anthology ID:
2026.politicalnlp-1.23
Volume:
Proceedings of the 3rd Workshop on Natural Language Processing for Political Sciences (PoliticalNLP 2026)
Month:
May
Year:
2026
Address:
Palma, Mallorca (Spain)
Editors:
Haithem Afli, Houda Bouamor, Wajdi Zaghouani, Sahar Ghannay, Shehenaz Hossain
Venues:
PoliticalNLP | WS
SIG:
Publisher:
ELRA Language Resources Association (ELRA)
Note:
Pages:
210–218
Language:
External URL:
https://lrec.elra.info/lrec2026-ws-politicalnlp-23
DOI:
10.63317/3azkyw9gr5hf
Bibkey:
Cite (ACL):
Nooredeen Awwad, Ebtihal Ismail Enfes, and Kolawole John Adebayo. 2026. Do LLMs Transfer Political Framing across Languages? A Cross-Lingual Analysis of LLM-Generated Discourse. In Proceedings of the 3rd Workshop on Natural Language Processing for Political Sciences (PoliticalNLP 2026), pages 210–218, Palma, Mallorca (Spain). ELRA Language Resources Association (ELRA).
Cite (Informal):
Do LLMs Transfer Political Framing across Languages? A Cross-Lingual Analysis of LLM-Generated Discourse (Awwad et al., PoliticalNLP 2026)
Copy Citation: