Unleashing the Power of Discourse-Enhanced Transformers for Propaganda Detection

Alexander Chernyavskiy, Dmitry Ilvovsky, Preslav Nakov


Abstract
The prevalence of information manipulation online has created a need for propaganda detection systems. Such systems have typically focused on the surface words, ignoring the linguistic structure. Here we aim to bridge this gap. In particular, we present the first attempt at using discourse analysis for the task. We consider both paragraph-level and token-level classification and we propose a discourse-aware Transformer architecture. Our experiments on English and Russian demonstrate sizeable performance gains compared to a number of baselines. Moreover, our ablation study emphasizes the importance of specific types of discourse features, and our in-depth analysis reveals a strong correlation between propaganda instances and discourse spans.
Anthology ID:
2024.eacl-long.87
Volume:
Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
March
Year:
2024
Address:
St. Julian’s, Malta
Editors:
Yvette Graham, Matthew Purver
Venue:
EACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1452–1462
Language:
URL:
https://aclanthology.org/2024.eacl-long.87
DOI:
Bibkey:
Cite (ACL):
Alexander Chernyavskiy, Dmitry Ilvovsky, and Preslav Nakov. 2024. Unleashing the Power of Discourse-Enhanced Transformers for Propaganda Detection. In Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers), pages 1452–1462, St. Julian’s, Malta. Association for Computational Linguistics.
Cite (Informal):
Unleashing the Power of Discourse-Enhanced Transformers for Propaganda Detection (Chernyavskiy et al., EACL 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.eacl-long.87.pdf
Software:
 2024.eacl-long.87.software.zip