Beyond Fake News Detection: A Community-based Study of the Multicultural Nature of Information Disorder

Sara Gemelli, Giulia Di Cristina, Yiran Zhang, Md Azizul Hoque, Alberto De La Torre Solís, Mohamad Mojtaba Behboudi Eshkiki, Nikolai Efimov, Mariia Everstova, Caterina Maria Cappello, Maziar Kianimoghadam Jouneghani, Payam Latifi, Yashar Mahboudi, Farzaneh Mohseni, Dario Placenti, Tommaso Caselli, Manuela Sanguinetti, Aurora Scarpellini, Chiara Zanchi, Usman Naseem, Marco Antonio Stranisci, Simona Frenda


Abstract
Recognizing disinformation is a challenging task for humans and AI systems. News can be false, misleading, or harmful, and its interpretation often depends on the cultural context of the audience. However, existing datasets rarely account for these contextual and cultural differences, as they are typically not designed from the perspective of news consumers. To address this gap, in this paper, we present the Information Disorder (InDor) corpus, a multilingual dataset of news articles in English, Farsi, Italian, and Russian, annotated for information disorder detection and explanation. The corpus was developed through a participatory process involving contributors from diverse cultural and professional backgrounds, who engaged in data collection, annotation, and evaluation of Large Language Model (LLM) performance on the task. Our findings highlight that false and manipulated news manifest differently across cultural settings, and that current LLMs fail to adequately capture this complexity. This underscores the need for culturally aware computational approaches in the study of information disorder.
Anthology ID:
2026.lrec-1.515
Volume:
Proceedings of the Fifteenth Language Resources and Evaluation Conference
Month:
May
Year:
2026
Address:
Palma de Mallorca, Spain
Editors:
Stelios Piperidis, Núria Bel, Henk van den Heuvel, Nancy Ide, Simon Krek, Antonio Toral
Venue:
LREC
SIG:
Publisher:
ELRA Language Resource Association
Note:
Pages:
6496–6508
Language:
External URL:
https://lrec.elra.info/lrec2026-main-515
DOI:
10.63317/4iyhqziwo6ri
Bibkey:
Cite (ACL):
Sara Gemelli, Giulia Di Cristina, Yiran Zhang, Md Azizul Hoque, Alberto De La Torre Solís, Mohamad Mojtaba Behboudi Eshkiki, Nikolai Efimov, Mariia Everstova, Caterina Maria Cappello, Maziar Kianimoghadam Jouneghani, Payam Latifi, Yashar Mahboudi, Farzaneh Mohseni, Dario Placenti, Tommaso Caselli, Manuela Sanguinetti, Aurora Scarpellini, Chiara Zanchi, Usman Naseem, Marco Antonio Stranisci, and Simona Frenda. 2026. Beyond Fake News Detection: A Community-based Study of the Multicultural Nature of Information Disorder. In Proceedings of the Fifteenth Language Resources and Evaluation Conference, pages 6496–6508, Palma de Mallorca, Spain. ELRA Language Resource Association.
Cite (Informal):
Beyond Fake News Detection: A Community-based Study of the Multicultural Nature of Information Disorder (Gemelli et al., LREC 2026)
Copy Citation: