Demographic Features for Annotation-Aware Classification

Narjes Tahaei, Sabine Bergler


Abstract
This paper revisits the use of annotator demographics as interpretable meta-information for modeling such variation. We adapt a lightweight attention mechanism, Annotation-Wise Attention Network (AWAN), to condition predictions on demographic features, enabling per-annotator modeling. Experiments on the EXIST sexism dataset show that AWAN improves classification performance over standard baselines, especially in cases of high annotator disagreement.
Anthology ID:
2025.ranlp-1.142
Volume:
Proceedings of the 15th International Conference on Recent Advances in Natural Language Processing - Natural Language Processing in the Generative AI Era
Month:
September
Year:
2025
Address:
Varna, Bulgaria
Editors:
Galia Angelova, Maria Kunilovskaya, Marie Escribe, Ruslan Mitkov
Venue:
RANLP
SIG:
Publisher:
INCOMA Ltd., Shoumen, Bulgaria
Note:
Pages:
1232–1236
Language:
URL:
https://aclanthology.org/2025.ranlp-1.142/
DOI:
Bibkey:
Cite (ACL):
Narjes Tahaei and Sabine Bergler. 2025. Demographic Features for Annotation-Aware Classification. In Proceedings of the 15th International Conference on Recent Advances in Natural Language Processing - Natural Language Processing in the Generative AI Era, pages 1232–1236, Varna, Bulgaria. INCOMA Ltd., Shoumen, Bulgaria.
Cite (Informal):
Demographic Features for Annotation-Aware Classification (Tahaei & Bergler, RANLP 2025)
Copy Citation:
PDF:
https://aclanthology.org/2025.ranlp-1.142.pdf