Jakob Fehle
2026
nchellwig at SemEval-2026 Task 3: Self-Consistent Structured Generation (SCSG) for Dimensional Aspect-Based Sentiment Analysis using Large Language Models
Nils Constantin Hellwig | Jakob Fehle | Udo Kruschwitz | Christian Wolff
Proceedings of the 20th International Workshop on Semantic Evaluation (2026)
Nils Constantin Hellwig | Jakob Fehle | Udo Kruschwitz | Christian Wolff
Proceedings of the 20th International Workshop on Semantic Evaluation (2026)
We present Self-Consistent Structured Generation (SCSG) for Dimensional Aspect-Based Sentiment Analysis in SemEval-2026 Task 3 (Track A). SCSG enhances prediction reliability by executing a LoRA-adapted large language model multiple times per instance, retaining only tuples that achieve a majority consensus across runs. To mitigate the computational overhead of multiple forward passes, we leverage vLLM’s PagedAttention mechanism for efficient key–value cache reuse. Evaluation across 6 languages and 8 language–domain combinations demonstrates that self-consistency with 15 executions yields statistically significant improvements over single-inference prompting, with our system (leveraging Gemma 3) ranking in the top seven across all settings, achieving second place on three out of four English subsets and first place on Tatar-Restaurant for DimASTE.
Annotation Quality in Aspect-Based Sentiment Analysis: A Case Study Comparing Experts, Students, Crowdworkers, and Large Language Models
Niklas Donhauser | Jakob Fehle | Nils Constantin Hellwig | Markus Weinberger | Udo Kruschwitz | Christian Wolff
Proceedings of the Fourth Workshop on the Role of Resources in the Age of Large Language Models (RESOURCEFUL 2026)
Niklas Donhauser | Jakob Fehle | Nils Constantin Hellwig | Markus Weinberger | Udo Kruschwitz | Christian Wolff
Proceedings of the Fourth Workshop on the Role of Resources in the Age of Large Language Models (RESOURCEFUL 2026)
Aspect-Based Sentiment Analysis (ABSA) enables fine-grained opinion analysis by identifying sentiments toward specific aspects or targets within a text. While ABSA has been widely studied for English, research on other languages such as German remains limited, largely due to the lack of high-quality annotated datasets. This paper examines how different annotation sources influence the development of German ABSA. To this end, an existing dataset is re-annotated by experts to establish a ground truth, which serves as a reference for evaluating annotations produced by students, crowdworkers, Large Language Models (LLMs), and experts. Annotation quality is compared using Inter-Annotator Agreement (IAA) and its impact on downstream model performance for different ABSA subtasks. The evaluation focuses on Aspect Category Sentiment Analysis (ACSA) and Target Aspect Sentiment Detection (TASD). We apply State-of-the-Art (SOTA) methods for ABSA, including BERT-, T5-, and LLaMA-based approaches to assess performance differences, spanning fine-tuning and in-context learning with instruction prompts. The findings provide practical insights into trade-offs between annotation reliability, and efficiency, offering guidance for dataset construction in under-resourced Natural Language Processing (NLP) scenarios.
Mobilize, Inform, Interact: Classifying Political Calls-to-Action Types on Instagram
Michael Achmann-Denkler | Clara Helmig | Jakob Fehle | Mario Haim | Christian Wolff
Proceedings of the 3rd Workshop on Natural Language Processing for Political Sciences (PoliticalNLP 2026)
Michael Achmann-Denkler | Clara Helmig | Jakob Fehle | Mario Haim | Christian Wolff
Proceedings of the 3rd Workshop on Natural Language Processing for Political Sciences (PoliticalNLP 2026)
Calls-to-action (CTAs) are central to digital campaigning, yet computational research has largely focused on binary detection only. We address CTA type classification in German Instagram campaign texts (posts and ephemeral stories), distinguishing Support, Inform, Interact, and No CTA. With limited annotated data, we benchmark a fine-tuned GBERT model against GPT models using zero-shot, few-shot, and retrieval-augmented few-shot prompting in a multi-label setup. Both approaches reach similar performance in five-fold cross-validation (macro-F1 ca. 0.79), with persistent difficulty on the rare Interact category. As a proof of concept, we apply the selected setup to the 2021 federal election corpus and show that parties varied not only in overall CTA use but also in how they balanced appeals across posts versus stories. The results demonstrate the feasibility of CTA type classification with modest data and position retrieval-augmented prompting as a practical alternative to supervised fine-tuning.
Zero-Shot to Full-Resource: Cross-lingual Transfer Strategies for Aspect-Based Sentiment Analysis
Jakob Fehle | Nils Constantin Hellwig | Udo Kruschwitz | Christian Wolff
Proceedings of the Fifteenth Language Resources and Evaluation Conference
Jakob Fehle | Nils Constantin Hellwig | Udo Kruschwitz | Christian Wolff
Proceedings of the Fifteenth Language Resources and Evaluation Conference
Aspect-based Sentiment Analysis (ABSA) extracts fine-grained opinions toward specific aspects within text but remains largely English-focused despite major advances in transformer-based and instruction-tuned models. This work presents a multilingual evaluation of state-of-the-art ABSA approaches across seven languages and four subtasks (ACD, ACSA, TASD, ASQP). We systematically compare different transformer architectures under zero-resource, data-only, and full-resource settings, using cross-lingual transfer, code-switching and machine translation. Fine-tuned Large Language Models (LLMs) achieve the highest overall scores, particularly in complex generative tasks, while few-shot counterparts approach this performance in simpler setups, where smaller encoder models also remain competitive. Cross-lingual training on multiple non-target languages yields the strongest transfer for fine-tuned LLMs, while smaller encoder or seq-to-seq models benefit most from code-switching, highlighting architecture-specific strategies for multilingual ABSA. We further contribute two new German datasets, an adapted GERestaurant and the first German ASQP dataset (GERest), to encourage multilingual ABSA research beyond English.
AnnoABSA: A Web-Based Annotation Tool for Aspect-Based Sentiment Analysis with Retrieval-Augmented Suggestions
Nils Constantin Hellwig | Jakob Fehle | Udo Kruschwitz | Christian Wolff
Proceedings of the Fifteenth Language Resources and Evaluation Conference
Nils Constantin Hellwig | Jakob Fehle | Udo Kruschwitz | Christian Wolff
Proceedings of the Fifteenth Language Resources and Evaluation Conference
We introduce AnnoABSA, the first web-based annotation tool to support the full spectrum of Aspect-Based Sentiment Analysis (ABSA) tasks. The tool is highly customizable, enabling flexible configuration of sentiment elements and task-specific requirements. Alongside manual annotation, AnnoABSA provides optional Large Language Model (LLM)-based retrieval-augmented generation (RAG) suggestions that offer context-aware assistance in a human-in-the-loop approach, keeping the human annotator in control. To improve prediction quality over time, the system retrieves the ten most similar examples that are already annotated and adds them as few-shot examples in the prompt, ensuring that suggestions become increasingly accurate as the annotation process progresses. Released as open-source software under the MIT License, AnnoABSA is freely accessible and easily extendable for research and practical applications.
LLM-as-an-Annotator: Training Lightweight Models with LLM-Annotated Examples for Aspect Sentiment Tuple Prediction
Nils Constantin Hellwig | Jakob Fehle | Udo Kruschwitz | Christian Wolff
Proceedings of the Fifteenth Language Resources and Evaluation Conference
Nils Constantin Hellwig | Jakob Fehle | Udo Kruschwitz | Christian Wolff
Proceedings of the Fifteenth Language Resources and Evaluation Conference
Training models for Aspect-Based Sentiment Analysis (ABSA) tasks requires manually annotated data, which is expensive and time-consuming to obtain. This paper introduces LA-ABSA, a novel approach that leverages Large Language Model (LLM)-generated annotations to fine-tune lightweight models for complex ABSA tasks. We evaluate our approach on five datasets for Target Aspect Sentiment Detection (TASD) and Aspect Sentiment Quad Prediction (ASQP). Our approach outperformed previously reported augmentation strategies and achieved competitive performance with LLM-prompting in low-resource scenarios, while providing substantial energy efficiency benefits. For example, using 50 annotated examples for in-context learning (ICL) to guide the annotation of unlabeled data, LA-ABSA achieved an F1 score of 49.85 for ASQP on the SemEval Rest16 dataset, closely matching the performance of ICL prompting with Gemma-3-27B (51.10), while requiring significantly lower computational resources.
2025
Do we still need Human Annotators? Prompting Large Language Models for Aspect Sentiment Quad Prediction
Nils Constantin Hellwig | Jakob Fehle | Udo Kruschwitz | Christian Wolff
Proceedings of the 1st Joint Workshop on Large Language Models and Structure Modeling (XLLM 2025)
Nils Constantin Hellwig | Jakob Fehle | Udo Kruschwitz | Christian Wolff
Proceedings of the 1st Joint Workshop on Large Language Models and Structure Modeling (XLLM 2025)
Aspect sentiment quad prediction (ASQP) facilitates a detailed understanding of opinions expressed in a text by identifying the opinion term, aspect term, aspect category and sentiment polarity for each opinion. However, annotating a full set of training examples to fine-tune models for ASQP is a resource-intensive process. In this study, we explore the capabilities of large language models (LLMs) for zero- and few-shot learning on the ASQP task across five diverse datasets. We report F1 scores almost up to par with those obtained with state-of-the-art fine-tuned models and exceeding previously reported zero- and few-shot performance. In the 20-shot setting on the Rest16 restaurant domain dataset, LLMs achieved an F1 score of 51.54, compared to 60.39 by the best-performing fine-tuned method MVP. Additionally, we report the performance of LLMs in target aspect sentiment detection (TASD), where the F1 scores were close to fine-tuned models, achieving 68.93 on Rest16 in the 30-shot setting, compared to 72.76 with MVP. While human annotators remain essential for achieving optimal performance, LLMs can reduce the need for extensive manual annotation in ASQP tasks.
German Aspect-based Sentiment Analysis in the Wild: B2B Dataset Creation and Cross-Domain Evaluation
Jakob Fehle | Niklas Donhauser | Udo Kruschwitz | Nils Constantin Hellwig | Christian Wolff
Proceedings of the 21st Conference on Natural Language Processing (KONVENS 2025): Long and Short Papers
Jakob Fehle | Niklas Donhauser | Udo Kruschwitz | Nils Constantin Hellwig | Christian Wolff
Proceedings of the 21st Conference on Natural Language Processing (KONVENS 2025): Long and Short Papers
2024
GERestaurant: A German Dataset of Annotated Restaurant Reviews for Aspect-Based Sentiment Analysis
Nils Constantin Hellwig | Jakob Fehle | Markus Bink | Christian Wolff
Proceedings of the 20th Conference on Natural Language Processing (KONVENS 2024)
Nils Constantin Hellwig | Jakob Fehle | Markus Bink | Christian Wolff
Proceedings of the 20th Conference on Natural Language Processing (KONVENS 2024)
Detecting Calls to Action in Multimodal Content: Analysis of the 2021 German Federal Election Campaign on Instagram
Michael Achmann-Denkler | Jakob Fehle | Mario Haim | Christian Wolff
Proceedings of the 4th Workshop on Computational Linguistics for the Political and Social Sciences: Long and short papers
Michael Achmann-Denkler | Jakob Fehle | Mario Haim | Christian Wolff
Proceedings of the 4th Workshop on Computational Linguistics for the Political and Social Sciences: Long and short papers
This study investigates the automated classification of Calls to Action (CTAs) within the 2021 German Instagram election campaign to advance the understanding of mobilization in social media contexts. We analyzed over 2,208 Instagram stories and 712 posts using fine-tuned BERT models and OpenAI’s GPT-4 models. The fine-tuned BERT model incorporating synthetic training data achieved a macro F1 score of 0.93, demonstrating a robust classification performance. Our analysis revealed that 49.58% of Instagram posts and 10.64% of stories contained CTAs, highlighting significant differences in mobilization strategies between these content types. Additionally, we found that FDP and the Greens had the highest prevalence of CTAs in posts, whereas CDU and CSU led in story CTAs.
2023
Aspect-Based Sentiment Analysis as a Multi-Label Classification Task on the Domain of German Hotel Reviews
Jakob Fehle | Leonie Münster | Thomas Schmidt | Christian Wolff
Proceedings of the 19th Conference on Natural Language Processing (KONVENS 2023)
Jakob Fehle | Leonie Münster | Thomas Schmidt | Christian Wolff
Proceedings of the 19th Conference on Natural Language Processing (KONVENS 2023)
Transformer-Based Analysis of Sentiment Towards German Political Parties on Twitter During the 2021 Election Year
Nils Constantin Hellwig | Markus Bink | Thomas Schmidt | Jakob Fehle | Christian Wolff
Proceedings of the 6th International Conference on Natural Language and Speech Processing (ICNLSP 2023)
Nils Constantin Hellwig | Markus Bink | Thomas Schmidt | Jakob Fehle | Christian Wolff
Proceedings of the 6th International Conference on Natural Language and Speech Processing (ICNLSP 2023)
2022
Sentiment Analysis on Twitter for the Major German Parties during the 2021 German Federal Election
Thomas Schmidt | Jakob Fehle | Maximilian Weissenbacher | Jonathan Richter | Philipp Gottschalk | Christian Wolff
Proceedings of the 18th Conference on Natural Language Processing (KONVENS 2022)
Thomas Schmidt | Jakob Fehle | Maximilian Weissenbacher | Jonathan Richter | Philipp Gottschalk | Christian Wolff
Proceedings of the 18th Conference on Natural Language Processing (KONVENS 2022)