Why Should This Article Be Deleted? Transparent Stance Detection in Multilingual Wikipedia Editor Discussions

Lucie-Aimée Kaffee, Arnav Arora, Isabelle Augenstein


Abstract
The moderation of content on online platforms is usually non-transparent. On Wikipedia, however, this discussion is carried out publicly and editors are encouraged to use the content moderation policies as explanations for making moderation decisions. Currently, only a few comments explicitly mention those policies – 20% of the English ones, but as few as 2% of the German and Turkish comments. To aid in this process of understanding how content is moderated, we construct a novel multilingual dataset of Wikipedia editor discussions along with their reasoning in three languages. The dataset contains the stances of the editors (keep, delete, merge, comment), along with the stated reason, and a content moderation policy, for each edit decision. We demonstrate that stance and corresponding reason (policy) can be predicted jointly with a high degree of accuracy, adding transparency to the decision-making process. We release both our joint prediction models and the multilingual content moderation dataset for further research on automated transparent content moderation.
Anthology ID:
2023.emnlp-main.361
Volume:
Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing
Month:
December
Year:
2023
Address:
Singapore
Editors:
Houda Bouamor, Juan Pino, Kalika Bali
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
5891–5909
Language:
URL:
https://aclanthology.org/2023.emnlp-main.361
DOI:
10.18653/v1/2023.emnlp-main.361
Bibkey:
Cite (ACL):
Lucie-Aimée Kaffee, Arnav Arora, and Isabelle Augenstein. 2023. Why Should This Article Be Deleted? Transparent Stance Detection in Multilingual Wikipedia Editor Discussions. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 5891–5909, Singapore. Association for Computational Linguistics.
Cite (Informal):
Why Should This Article Be Deleted? Transparent Stance Detection in Multilingual Wikipedia Editor Discussions (Kaffee et al., EMNLP 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.emnlp-main.361.pdf
Video:
 https://aclanthology.org/2023.emnlp-main.361.mp4