Mareike Lisker
Author directory2026
Who’s Behind It? Annotating and Extracting Conspiratorial Actors from German Telegram Posts
Helena Mihaljevic | Jolanda Beer | Mareike Lisker | Katharina Soemer
Proceedings of the 10th Workshop on Online Abuse and Harms (WOAH)
Helena Mihaljevic | Jolanda Beer | Mareike Lisker | Katharina Soemer
Proceedings of the 10th Workshop on Online Abuse and Harms (WOAH)
Conspiracy theories commonly attribute important events to the actions of powerful and secretive actors. While computational research has largely focused on document-level analyses of conspiracy theories, less attention has been paid to identifying the actors portrayed as responsible in such narratives. We develop detailed guidelines for the span-level annotation of conspiratorial actors and use them to create a corpus of German Telegram posts, before investigating automatic actor extraction using transformer-based models. We further apply the resulting model to the Schwurbelarchiv, a large-scale archive of German conspiracy-related Telegram channels. Our results demonstrate that conspiratorial actors can be annotated consistently and extracted with reasonable accuracy despite the linguistic complexity of conspiracy discourse, enabling large-scale analyses of actor representations in conspiracy narratives.
Bye Bye Perspective API: Lessons for Building and Governing Measurement Infrastructure
David Hartmann | Manuel Tonneau | Angelie Kraft | LK Seiling | Dimitri Staufer | Pieter Delobelle | Jan Fillies | Anna Ricarda Luther | Jan Batzner | Mareike Lisker
Findings of the Association for Computational Linguistics: EMNLP 2026
David Hartmann | Manuel Tonneau | Angelie Kraft | LK Seiling | Dimitri Staufer | Pieter Delobelle | Jan Fillies | Anna Ricarda Luther | Jan Batzner | Mareike Lisker
Findings of the Association for Computational Linguistics: EMNLP 2026
Perspective API closes at the end of 2026, removing the de facto standard for toxicity measurement and exposing researchers’ dependence on a tool they did not control. Drawing on this case, we argue that a research field must build and govern its own measurement infrastructure rather than borrow it. Surveying 241 papers that use or study Perspective, we show what depending on it cost the research community: claims reaching past what the tool could support, results that shifted when its model was silently retrained, and disparities researchers could measure but not explain. These failures were amplified throughout the LLM lifecycle, where Perspective supplied the labels, filtered the corpora, and graded the systems trained on each, rewarding errors rather than catching them. To keep the instrument open to study after shutdown, we release Perspective scores for 5.9 million text snippets from 77 datasets. We further specify ten requirements for measurement infrastructure a field owns, and argue that what blocks such infrastructure is not technical capability but the value the field places on infrastructure work.
2025
Debunking with Dialogue? Exploring AI-Generated Counterspeech to Challenge Conspiracy Theories
Mareike Lisker | Christina Gottschalk | Helena Mihaljević
Proceedings of the 9th Workshop on Online Abuse and Harms (WOAH)
Mareike Lisker | Christina Gottschalk | Helena Mihaljević
Proceedings of the 9th Workshop on Online Abuse and Harms (WOAH)
Counterspeech is a key strategy against harmful online content, but scaling expert-driven efforts is challenging. Large Language Models (LLMs) present a potential solution, though their use in countering conspiracy theories is under-researched. Unlike for hate speech, no datasets exist that pair conspiracy theory comments with expert-crafted counterspeech. We address this gap by evaluating the ability of GPT-4o, Llama 3, and Mistral to effectively apply counterspeech strategies derived from psychological research provided through structured prompts. Our results show that the models often generate generic, repetitive, or superficial results. Additionally, they over-acknowledge fear and frequently hallucinate facts, sources, or figures, making their prompt-based use in practical applications problematic.