Maarten Bos
2024
Explainability and Hate Speech: Structured Explanations Make Social Media Moderators Faster
Agostina Calabrese
|
Leonardo Neves
|
Neil Shah
|
Maarten Bos
|
Björn Ross
|
Mirella Lapata
|
Francesco Barbieri
Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)
Content moderators play a key role in keeping the conversation on social media healthy. While the high volume of content they need to judge represents a bottleneck to the moderation pipeline, no studies have explored how models could support them to make faster decisions. There is, by now, a vast body of research into detecting hate speech, sometimes explicitly motivated by a desire to help improve content moderation, but published research using real content moderators is scarce. In this work we investigate the effect of explanations on the speed of real-world moderators. Our experiments show that while generic explanations do not affect their speed and are often ignored, structured explanations lower moderators’ decision making time by 7.4%.
2023
SemEval-2023 Task 9: Multilingual Tweet Intimacy Analysis
Jiaxin Pei
|
Vítor Silva
|
Maarten Bos
|
Yozen Liu
|
Leonardo Neves
|
David Jurgens
|
Francesco Barbieri
Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023)
Intimacy is an important social aspect of language. Computational modeling of intimacy in language could help many downstream applications like dialogue systems and offensiveness detection. Despite its importance, resources and approaches on modeling textual intimacy remain rare. To address this gap, we introduce MINT, a new Multilingual intimacy analysis dataset covering 13,372 tweets in 10 languages including English, French, Spanish, Italian, Portuguese, Korean, Dutch, Chinese, Hindi, and Arabic along with SemEval 2023 Task 9: Multilingual Tweet Intimacy Analysis. Our task attracted 45 participants from around the world. While the participants are able to achieve overall good performance on languages in the training set, zero-shot prediction of intimacy in unseen languages remains challenging. Here we provide an overview of the task, summaries of the common approaches, and potential future directions on modeling intimacy across languages. All the relevant resources are available at https: //sites.google.com/umich.edu/ semeval-2023-tweet-intimacy.
Search
Co-authors
- Leonardo Neves 2
- Francesco Barbieri 2
- Jiaxin Pei 1
- Vítor Silva 1
- Yozen Liu 1
- show all...