Katarina Laken
Author directory2026
Mute Cods: A Multilingual Telegram Dataset with Benchmark Models for Conspiracy Theory Detection
Katarina Laken | Erik Bran Marino | Paloma Piot | Davide Bassi | Søren Kirkegaard Fomsgaard | Michele Joshua Maggini | Renata Vieira | Marcos Garcia | Sara Tonelli
Proceedings of the Fifteenth Language Resources and Evaluation Conference
Katarina Laken | Erik Bran Marino | Paloma Piot | Davide Bassi | Søren Kirkegaard Fomsgaard | Michele Joshua Maggini | Renata Vieira | Marcos Garcia | Sara Tonelli
Proceedings of the Fifteenth Language Resources and Evaluation Conference
The proliferation of conspiracy theories and hateful messages on social media poses significant challenges for content moderation and public discourse. Despite their societal impact, existing datasets for automated conspiracy detection remain limited in scope and language coverage. We present a multilingual dataset of conspiracy content on Telegram comprising 5750 messages across English, Dutch, Italian, Spanish and Portuguese from 87 channels documented as disseminating conspiracist and extremist content. Domain experts annotated messages for conspiracist tone, population replacement conspiracy theories, vaccine conspiracies, and hate speech. We extensively report on difficulties and caveats when creating and annotating this type of dataset. We establish classification baselines by evaluating six models in zero-shot fashion and fine-tuning three encoder models, achieving F1 scores up to 0.800 for conspiracist tone, 0.846 for PRCT, 0.843 for vaccine-related conspiracy theories, and 0.734 for hate speech. Inter-annotator agreement was moderate, consistent with the complexity documented in similar annotation tasks.
Combating Disinformation: Is There No Alternative?
Davide Bassi | Søren Kirkegaard Fomsgaard | Erik Bran Marino | Katarina Laken
Proceedings of the 1st Workshop on Information Disorder (InDor) @ LREC 2026
Davide Bassi | Søren Kirkegaard Fomsgaard | Erik Bran Marino | Katarina Laken
Proceedings of the 1st Workshop on Information Disorder (InDor) @ LREC 2026
This position paper critiques the dominance of detection-centered approaches in misinformation research. We argue that the prevailing paradigm treats information disorders as a content-level anomaly to be identified and suppressed, thereby obscuring the structural conditions under which different forms of information disorders emerge and resonate. Drawing on critical anthropology, we propose an alternative “clinical” model: information disorders should be understood not only as informational distortion, but as a syndrome with complex causes embedded in contexts of economic precarity, institutional distrust, and informational inequality. Treating detection as the ends rather than the means of intervention risks misguiding our efforts. Rather than positioning NLP primarily as a tool for boundary enforcement, we outline a reorientation toward structural diagnosis: diversifying data beyond WEIRD contexts, extracting socioeconomic and trust-related signals from discourse, and integrating computational outputs within interdisciplinary causal frameworks. Under this model, detection becomes a means for an epidemiology of discourse, subordinated to the broader objective of cultivating long-term epistemic resilience in our online environments.
Beyond the Explicit: A Bilingual Dataset for Dehumanization Detection in Social Media
Dennis Assenmacher | Paloma Piot | Katarina Laken | David Jurgens | Claudia Wagner
Findings of the Association for Computational Linguistics: EMNLP 2026
Dennis Assenmacher | Paloma Piot | Katarina Laken | David Jurgens | Claudia Wagner
Findings of the Association for Computational Linguistics: EMNLP 2026
Digital dehumanization, although a critical issue, remains largely overlooked within the field of computational linguistics and Natural Language Processing (NLP). To our best knowledge, this work presents the most comprehensive annotated bi-lingual dataset on dehumanization, with almost 16.000 instances (44% dehumanizing) that exists today and can serve as both a training resource for machine learning models and a benchmark for evaluating future dehumanization detection techniques. Our comparison of 15 methods shows that traditional hate speech detection approaches perform poorly on dehumanization detection, particularly for implicit forms. By leveraging our dataset in few-shot and fine-tuning settings, LLMs achieve comparable performance on implicit and explicit dehumanization and substantially outperform zero-shot baselines, with average gains of 39% and 65%, respectively. However, detection accuracy remains slightly lower for mechanistic than for animalistic dehumanization, the latter being the dominant focus of prior work.
2025
Multilingual Analysis of Narrative Properties in Conspiracist vs Mainstream Telegram Channels
Katarina Laken | Matteo Melis | Sara Tonelli | Marcos Garcia
Proceedings of the 9th Workshop on Online Abuse and Harms (WOAH)
Katarina Laken | Matteo Melis | Sara Tonelli | Marcos Garcia
Proceedings of the 9th Workshop on Online Abuse and Harms (WOAH)
Conspiracist narratives posit an omnipotent, evil group causing harm throughout domains. However, modern-day online conspiracism is often more erratic, consisting of loosely connected posts displaying a general anti-establishment attitude pervaded by negative emotions. We gather a dataset of 300 conspiracist and mainstream, Telegram channels in Italian and English and use the automatic extraction of entities and emotion detection to compare structural characteristics of both types of channels. We create a co-occurrence network of entities to analyze how the different types of channels introduce and use them across posts and topics. We find that conspiracist channels are characterized by anger. Moreover, co-occurrence networks of entities appearing in conspiracist channels are more dense. We theorize that this reflects a narrative structure where all actants are pushed into a single domain. Conspiracist channels disproportionately associate the most central group of entities with anger and fear. We do not find evidence that entities in conspiracist narratives occur across more topics. This could indicate an erratic type of online conspiracism where everything can be connected to everything and that is characterized by a high number of entities and high levels of anger.
2024
Fralak at SemEval-2024 Task 4: combining RNN-generated hierarchy paths with simple neural nets for hierarchical multilabel text classification in a multilingual zero-shot setting
Katarina Laken
Proceedings of the 18th International Workshop on Semantic Evaluation (SemEval-2024)
Katarina Laken
Proceedings of the 18th International Workshop on Semantic Evaluation (SemEval-2024)
This paper describes the submission of team fralak for subtask 1 of task 4 of the Semeval-2024 shared task: ‘Multilingual detection of persuasion techniques in memes’. The first subtask included only the textual content of the memes. We restructured the labels into strings that showed the full path through the hierarchy. The system includes an RNN module that is trained to generate these strings. This module was then incorporated in an ensemble model with 2 more models consisting of basic fully connected networks. Although our model did not perform particularly well on the English only setting, we found that it generalized better to other languages in a zero-shot context than most other models. Some additional experiments were performed to explain this. Findings suggest that the RNN generating the restructured labels generalized well across languages, but preprocessing did not seem to play a role. We conclude by giving suggestions for future improvements of our core idea.