The uncivil empathy: Investigating the relation between empathy and toxicity in online mental health support forums

Ming-Bin Chen, Jey Han Lau, Lea Frermann


Abstract
We explore the relationship between empathy and toxicity in the context of online mental health forums. Despite the common assumption of a negative correlation between these concepts, it has not been empirically examined. We augment the EPITOME mental health empathy dataset with toxicity labels using two widely employed toxic/harmful content detection APIs: Perspective API and OpenAI moderation API. We find a notable presence of toxic/harmful content (17.77%) within empathetic responses, and only a very weak negative correlation between the two variables. Qualitative analysis revealed contributions labeled as empathetic often contain harmful content such as promotion of suicidal ideas. Our results highlight the need for reevaluating empathy independently from toxicity in future research and encourage a reconsideration of empathy’s role in natural language generation and evaluation.
Anthology ID:
2023.alta-1.16
Volume:
Proceedings of the 21st Annual Workshop of the Australasian Language Technology Association
Month:
November
Year:
2023
Address:
Melbourne, Australia
Editors:
Smaranda Muresan, Vivian Chen, Kennington Casey, Vandyke David, Dethlefs Nina, Inoue Koji, Ekstedt Erik, Ultes Stefan
Venue:
ALTA
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
136–147
Language:
URL:
https://aclanthology.org/2023.alta-1.16
DOI:
Bibkey:
Cite (ACL):
Ming-Bin Chen, Jey Han Lau, and Lea Frermann. 2023. The uncivil empathy: Investigating the relation between empathy and toxicity in online mental health support forums. In Proceedings of the 21st Annual Workshop of the Australasian Language Technology Association, pages 136–147, Melbourne, Australia. Association for Computational Linguistics.
Cite (Informal):
The uncivil empathy: Investigating the relation between empathy and toxicity in online mental health support forums (Chen et al., ALTA 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.alta-1.16.pdf