Fine-Tuned Encoders versus Zero-Shot Prompting for Detecting Threat and Solution Framing in German Climate News

Raven Adam, Marie Lisa Kogler, David Maier


Abstract
News media play a central role in shaping public perceptions of climate change, and whether coverage emphasizes threats or solutions affects audience engagement and policy support. We compare fine-tuned encoders and zero-shot prompting for classifying sentences from German-language climate news as threatoriented, solution-oriented, both, or neither, using two independent binary classifiers. We finetune three German encoders with context windows ranging from the target sentence alone to four preceding and four following sentences, and compare them with three open-weights generative models and the non-generative decision model Jev. All models are evaluated with article-grouped five-fold cross-validation on 440 manually coded Austrian newspaper articles. The best encoder, GBERT-large with the widest context, achieves weighted F1 scores of 0.805 (threat) and 0.802 (solution). The recently released MiMo-V2.6-Flash reaches 0.807 and 0.798 without task-specific training, placing both approaches on par, whereas earlier prompting models remain below the best encoder. Additional context improves all encoders consistently, by up to 4.8 F1 points. On the natural class distribution, MiMo-V2.6- Flash outperforms GBERT-large on threat classification, while GBERT-large retains a small advantage for solution classification. These results indicate that the gap between fine-tuned encoders and prompted language models has only recently been closed.
Anthology ID:
2026.climatenlp-1.12
Volume:
Proceedings of the 3rd Workshop on Natural Language Processing Meets Climate Change (ClimateNLP 2026)
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Tobias Schimanski, Aida Usmanova, Gaku Morio, Jingwei Ni, Kalyan Dutia, Seyed Saeid Vaghefi, Dominik Stammbach, Markus Leippold
Venues:
ClimateNLP | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
158–169
Language:
URL:
https://aclanthology.org/2026.climatenlp-1.12/
DOI:
Bibkey:
Cite (ACL):
Raven Adam, Marie Lisa Kogler, and David Maier. 2026. Fine-Tuned Encoders versus Zero-Shot Prompting for Detecting Threat and Solution Framing in German Climate News. In Proceedings of the 3rd Workshop on Natural Language Processing Meets Climate Change (ClimateNLP 2026), pages 158–169, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Fine-Tuned Encoders versus Zero-Shot Prompting for Detecting Threat and Solution Framing in German Climate News (Adam et al., ClimateNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.climatenlp-1.12.pdf