Language Ideologies in a Multilingual Society: An LLM-based Analysis of Luxembourgish News Comments

Emilia Milano, Alistair Plum, Yves Scherrer, Christoph Purschke


Abstract
Detecting language ideologies is a valuable yet complex task for understanding how identities are constructed through discourse. In Luxembourg’s multicultural and multilingual society, language ideologies reflect more than simple preferences: they carry deep cultural and social meanings, shaping identities and social belonging. Following recent developments in applying Natural Language Processing tools to linguistics and social science, this paper explores the potential of large language models to assist in the detection of language ideologies. We manually annotate a corpus of user comments in Luxembourgish with predefined ideological categories and then evaluate the performance of large language models under varying prompt conditions to assess their ability to replicate these human annotations. Since Luxembourgish is a small language and poorly represented in the LLMs’ training data, we also investigate whether machine-translating the data to high-resource languages increases performance on the ideology detection task. Our findings suggest that, while LLMs are not yet fully optimized for a multi-class ideological annotation task, they are practical tools to identify language ideological content.
Anthology ID:
2026.socon-1.12
Volume:
Proceedings of the 1st Workshop on Social Context (SoCon) and the 2nd Workshop on Integrating NLP and Psychology to Study Social Interactions (NLPSI) @ LREC 2026
Month:
May
Year:
2026
Address:
Palma, Mallorca (Spain)
Editors:
Marco Antonio Stranisci, Neele Falk, Sofie Labat, Soda Marem Lo, Aswathy Velutharambath, Sabine Weber, Rossana Damiano, Simona Frenda, Veronique Hoste, Bennett Kleinberg, Roman Klinger, Viviana Patti, Flor Miriam Plaza-del-Arco, Maarten Sap, Seid Muhie Yimam
Venues:
SoCon | NLPSI | WS
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
114–131
Language:
External URL:
https://lrec.elra.info/lrec2026-ws-soconnlpsi-12
DOI:
10.63317/48kwvvr63gms
Bibkey:
Cite (ACL):
Emilia Milano, Alistair Plum, Yves Scherrer, and Christoph Purschke. 2026. Language Ideologies in a Multilingual Society: An LLM-based Analysis of Luxembourgish News Comments. In Proceedings of the 1st Workshop on Social Context (SoCon) and the 2nd Workshop on Integrating NLP and Psychology to Study Social Interactions (NLPSI) @ LREC 2026, pages 114–131, Palma, Mallorca (Spain). European Language Resources Association (ELRA).
Cite (Informal):
Language Ideologies in a Multilingual Society: An LLM-based Analysis of Luxembourgish News Comments (Milano et al., SoCon-NLPSI 2026)
Copy Citation: