Sentiment-guided Transformer with Severity-aware Contrastive Learning for Depression Detection on Social Media

Tianlin Zhang, Kailai Yang, Sophia Ananiadou


Abstract
Early identification of depression is beneficial to public health surveillance and disease treatment. There are many models that mainly treat the detection as a binary classification task, such as detecting whether a user is depressed. However, identifying users’ depression severity levels from posts on social media is more clinically useful for future prevention and treatment. Existing severity detection methods mainly model the semantic information of posts while ignoring the relevant sentiment information, which can reflect the user’s state of mind and could be helpful for severity detection. In addition, they treat all severity levels equally, making the model difficult to distinguish between closely-labeled categories. We propose a sentiment-guided Transformer model, which efficiently fuses social media posts’ semantic information with sentiment information. Furthermore, we also utilize a supervised severity-aware contrastive learning framework to enable the model to better distinguish between different severity levels. The experimental results show that our model achieves superior performance on two public datasets, while further analysis proves the effectiveness of all proposed modules.
Anthology ID:
2023.bionlp-1.9
Volume:
The 22nd Workshop on Biomedical Natural Language Processing and BioNLP Shared Tasks
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Dina Demner-fushman, Sophia Ananiadou, Kevin Cohen
Venue:
BioNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
114–126
Language:
URL:
https://aclanthology.org/2023.bionlp-1.9
DOI:
10.18653/v1/2023.bionlp-1.9
Bibkey:
Cite (ACL):
Tianlin Zhang, Kailai Yang, and Sophia Ananiadou. 2023. Sentiment-guided Transformer with Severity-aware Contrastive Learning for Depression Detection on Social Media. In The 22nd Workshop on Biomedical Natural Language Processing and BioNLP Shared Tasks, pages 114–126, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
Sentiment-guided Transformer with Severity-aware Contrastive Learning for Depression Detection on Social Media (Zhang et al., BioNLP 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.bionlp-1.9.pdf