APatt at SemEval-2023 Task 3: The Sapienza NLP System for Ensemble-based Multilingual Propaganda Detection

Antonio Purificato, Roberto Navigli


Abstract
In this paper, we present our approach to the task of identification of persuasion techniques in text, which is a subtask of the SemEval-2023 Task 3 on the multilingual detection of genre, framing, and persuasion techniques in online news. The subtask is multi-label at the paragraph level and the inventory considered by the organizers covers 23 persuasion techniques. Our solution is based on an ensemble of a variety of pre-trained language models (PLMs) fine-tuned on the propaganda dataset. We first describe our system, the different experimental setups we considered, and then provide the results on the dev and test sets released by the organizers. The official evaluation shows our solution ranks 1st in English and attains high scores in all the other languages, i.e. French, German, Italian, Polish, and Russian. We also perform an extensive analysis of the data and the annotations to investigate how they can influence the quality of our systems.
Anthology ID:
2023.semeval-1.51
Volume:
Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023)
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Atul Kr. Ojha, A. Seza Doğruöz, Giovanni Da San Martino, Harish Tayyar Madabushi, Ritesh Kumar, Elisa Sartori
Venue:
SemEval
SIG:
SIGLEX
Publisher:
Association for Computational Linguistics
Note:
Pages:
382–388
Language:
URL:
https://aclanthology.org/2023.semeval-1.51
DOI:
10.18653/v1/2023.semeval-1.51
Bibkey:
Cite (ACL):
Antonio Purificato and Roberto Navigli. 2023. APatt at SemEval-2023 Task 3: The Sapienza NLP System for Ensemble-based Multilingual Propaganda Detection. In Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023), pages 382–388, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
APatt at SemEval-2023 Task 3: The Sapienza NLP System for Ensemble-based Multilingual Propaganda Detection (Purificato & Navigli, SemEval 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.semeval-1.51.pdf
Video:
 https://aclanthology.org/2023.semeval-1.51.mp4