DisorBERT: A Double Domain Adaptation Model for Detecting Signs of Mental Disorders in Social Media

Mario Aragon, Adrian Pastor Lopez Monroy, Luis Gonzalez, David E. Losada, Manuel Montes


Abstract
Mental disorders affect millions of people worldwide and cause interference with their thinking and behavior. Through the past years, awareness created by health campaigns and other sources motivated the study of these disorders using information extracted from social media platforms. In this work, we aim to contribute to the study of these disorders and to the understanding of how mental problems reflect on social media. To achieve this goal, we propose a double-domain adaptation of a language model. First, we adapted the model to social media language, and then, we adapted it to the mental health domain. In both steps, we incorporated a lexical resource to guide the masking process of the language model and, therefore, to help it in paying more attention to words related to mental disorders. We have evaluated our model in the detection of signs of three major mental disorders: Anorexia, Self-harm, and Depression. Results are encouraging as they show that the proposed adaptation enhances the classification performance and yields competitive results against state-of-the-art methods.
Anthology ID:
2023.acl-long.853
Volume:
Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Anna Rogers, Jordan Boyd-Graber, Naoaki Okazaki
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
15305–15318
Language:
URL:
https://aclanthology.org/2023.acl-long.853
DOI:
10.18653/v1/2023.acl-long.853
Bibkey:
Cite (ACL):
Mario Aragon, Adrian Pastor Lopez Monroy, Luis Gonzalez, David E. Losada, and Manuel Montes. 2023. DisorBERT: A Double Domain Adaptation Model for Detecting Signs of Mental Disorders in Social Media. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 15305–15318, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
DisorBERT: A Double Domain Adaptation Model for Detecting Signs of Mental Disorders in Social Media (Aragon et al., ACL 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.acl-long.853.pdf
Video:
 https://aclanthology.org/2023.acl-long.853.mp4