Disentangling Dialect from Social Bias via Multitask Learning to Improve Fairness

Maximilian Spliethöver, Sai Nikhil Menon, Henning Wachsmuth


Abstract
Dialects introduce syntactic and lexical variations in language that occur in regional or social groups. Most NLP methods are not sensitive to such variations. This may lead to unfair behavior of the methods, conveying negative bias towards dialect speakers. While previous work has studied dialect-related fairness for aspects like hate speech, other aspects of biased language, such as lewdness, remain fully unexplored. To fill this gap, we investigate performance disparities between dialects in the detection of five aspects of biased language and how to mitigate them. To alleviate bias, we present a multitask learning approach that models dialect language as an auxiliary task to incorporate syntactic and lexical variations. In our experiments with African-American English dialect, we provide empirical evidence that complementing common learning approaches with dialect modeling improves their fairness. Furthermore, the results suggest that multitask learning achieves state-of-the-art performance and helps to detect properties of biased language more reliably.
Anthology ID:
2024.findings-acl.553
Volume:
Findings of the Association for Computational Linguistics: ACL 2024
Month:
August
Year:
2024
Address:
Bangkok, Thailand
Editors:
Lun-Wei Ku, Andre Martins, Vivek Srikumar
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
9294–9313
Language:
URL:
https://aclanthology.org/2024.findings-acl.553
DOI:
10.18653/v1/2024.findings-acl.553
Bibkey:
Cite (ACL):
Maximilian Spliethöver, Sai Nikhil Menon, and Henning Wachsmuth. 2024. Disentangling Dialect from Social Bias via Multitask Learning to Improve Fairness. In Findings of the Association for Computational Linguistics: ACL 2024, pages 9294–9313, Bangkok, Thailand. Association for Computational Linguistics.
Cite (Informal):
Disentangling Dialect from Social Bias via Multitask Learning to Improve Fairness (Spliethöver et al., Findings 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.findings-acl.553.pdf