ACCEPT at SemEval-2023 Task 3: An Ensemble-based Approach to Multilingual Framing Detection

Philipp Heinisch, Moritz Plenz, Anette Frank, Philipp Cimiano


Abstract
This paper describes the system and experimental results of an ensemble-based approach tomultilingual framing detection for the submission of the ACCEPT team to the SemEval-2023 Task 3 on Framing Detection (Subtask 2). The approach is based on an ensemble that combines three different methods: a classifier based on large language models, a classifier based on static word embeddings, and an approach that uses external commonsense knowledge graphs, in particular, ConceptNet. The results of the three classification heads are aggregated into an overall prediction for each frame class. Our best submission yielded a micro F1-score of 50.69% (rank 10) and a macro F1-score of 50.20% (rank 3) for English articles. Our experimental results show that static word embeddings and knowledge graphs are useful components for frame detection, while the ensemble of all three methods combines the strengths of our three proposed methods. Through system ablations, we show that the commonsenseguided knowledge graphs are the outperforming method for many languages.
Anthology ID:
2023.semeval-1.187
Volume:
Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023)
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Atul Kr. Ojha, A. Seza Doğruöz, Giovanni Da San Martino, Harish Tayyar Madabushi, Ritesh Kumar, Elisa Sartori
Venue:
SemEval
SIG:
SIGLEX
Publisher:
Association for Computational Linguistics
Note:
Pages:
1347–1358
Language:
URL:
https://aclanthology.org/2023.semeval-1.187
DOI:
10.18653/v1/2023.semeval-1.187
Bibkey:
Cite (ACL):
Philipp Heinisch, Moritz Plenz, Anette Frank, and Philipp Cimiano. 2023. ACCEPT at SemEval-2023 Task 3: An Ensemble-based Approach to Multilingual Framing Detection. In Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023), pages 1347–1358, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
ACCEPT at SemEval-2023 Task 3: An Ensemble-based Approach to Multilingual Framing Detection (Heinisch et al., SemEval 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.semeval-1.187.pdf
Video:
 https://aclanthology.org/2023.semeval-1.187.mp4