ParsHate: A Benchmark Dataset for Hate and Target Detection in Persian

Zahra Bokaei, Walid Magdy, Bonnie Webber


Abstract
We introduce ParsHate, a manually annotated dataset of 10,000 Persian tweets spanning 2013–2022, representing the first decade-long benchmark for hate speech detection in Persian. The dataset contains 31% hateful content and supports both hate detection and multi-label fine-grained target identification across seven structured target categories. ParsHate also distinguishes explicit and implicit hate, marks explicit and implicit targets, and provides span-level rationales. Data collection combines random and score-stratified temporal sampling to reduce keyword-driven bias while preserving natural label distributions. Applying SOTA models for Persian hate-speech detection on ParsHate shows moderate performance (79% F1), especially with samples from earlier years, and low performance with target identification (25.5% macro-F1). This emphasizes the diverse sampling of hate speech in ParsHate and its challenging nature that requires more advanced methods for better performance. Dataset is made publicly available.
Anthology ID:
2026.emnlp-main.1406
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
32132–32149
Language:
URL:
https://aclanthology.org/2026.emnlp-main.1406/
DOI:
Bibkey:
Cite (ACL):
Zahra Bokaei, Walid Magdy, and Bonnie Webber. 2026. ParsHate: A Benchmark Dataset for Hate and Target Detection in Persian. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 32132–32149, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
ParsHate: A Benchmark Dataset for Hate and Target Detection in Persian (Bokaei et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.1406.pdf