Using Noisy Self-Reports to Predict Twitter User Demographics

Zach Wood-Doughty, Paiheng Xu, Xiao Liu, Mark Dredze


Abstract
Computational social science studies often contextualize content analysis within standard demographics. Since demographics are unavailable on many social media platforms (e.g. Twitter), numerous studies have inferred demographics automatically. Despite many studies presenting proof-of-concept inference of race and ethnicity, training of practical systems remains elusive since there are few annotated datasets. Existing datasets are small, inaccurate, or fail to cover the four most common racial and ethnic groups in the United States. We present a method to identify self-reports of race and ethnicity from Twitter profile descriptions. Despite the noise of automated supervision, our self-report datasets enable improvements in classification performance on gold standard self-report survey data. The result is a reproducible method for creating large-scale training resources for race and ethnicity.
Anthology ID:
2021.socialnlp-1.11
Volume:
Proceedings of the Ninth International Workshop on Natural Language Processing for Social Media
Month:
June
Year:
2021
Address:
Online
Editors:
Lun-Wei Ku, Cheng-Te Li
Venue:
SocialNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
123–137
Language:
URL:
https://aclanthology.org/2021.socialnlp-1.11
DOI:
10.18653/v1/2021.socialnlp-1.11
Bibkey:
Cite (ACL):
Zach Wood-Doughty, Paiheng Xu, Xiao Liu, and Mark Dredze. 2021. Using Noisy Self-Reports to Predict Twitter User Demographics. In Proceedings of the Ninth International Workshop on Natural Language Processing for Social Media, pages 123–137, Online. Association for Computational Linguistics.
Cite (Informal):
Using Noisy Self-Reports to Predict Twitter User Demographics (Wood-Doughty et al., SocialNLP 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.socialnlp-1.11.pdf
Code
 mdredze/demographer