PoliStance-TR: A Dataset for Turkish Stance Detection in Political Domain

Muhammed Cihat Unal, Yasemin Sarkın, Alper Karamanlioglu, Berkan Demirel


Abstract
Stance detection in NLP involves determining whether an author is supportive, against, or neutral towards a particular target. This task is particularly challenging for Turkish due to the limited availability of data, which hinders progress in the field. To address this issue, we introduce a novel dataset focused on stance detection in Turkish, specifically within the political domain. This dataset was collected from X (formerly Twitter) and annotated by three human annotators who followed predefined guidelines to ensure consistent labeling and generalizability. After compiling the dataset, we trained various transformer-based models with different architectures, showing that the dataset is effective for stance classification. These models achieved an impressive Macro F1 score of up to 82%, highlighting their effectiveness in stance detection.
Anthology ID:
2025.ranlp-1.148
Volume:
Proceedings of the 15th International Conference on Recent Advances in Natural Language Processing - Natural Language Processing in the Generative AI Era
Month:
September
Year:
2025
Address:
Varna, Bulgaria
Editors:
Galia Angelova, Maria Kunilovskaya, Marie Escribe, Ruslan Mitkov
Venue:
RANLP
SIG:
Publisher:
INCOMA Ltd., Shoumen, Bulgaria
Note:
Pages:
1282–1288
Language:
URL:
https://aclanthology.org/2025.ranlp-1.148/
DOI:
Bibkey:
Cite (ACL):
Muhammed Cihat Unal, Yasemin Sarkın, Alper Karamanlioglu, and Berkan Demirel. 2025. PoliStance-TR: A Dataset for Turkish Stance Detection in Political Domain. In Proceedings of the 15th International Conference on Recent Advances in Natural Language Processing - Natural Language Processing in the Generative AI Era, pages 1282–1288, Varna, Bulgaria. INCOMA Ltd., Shoumen, Bulgaria.
Cite (Informal):
PoliStance-TR: A Dataset for Turkish Stance Detection in Political Domain (Unal et al., RANLP 2025)
Copy Citation:
PDF:
https://aclanthology.org/2025.ranlp-1.148.pdf