BERT 4EVER@LT-EDI-ACL2022-Detecting signs of Depression from Social Media:Detecting Depression in Social Media using Prompt-Learning and Word-Emotion Cluster

Xiaotian Lin, Yingwen Fu, Ziyu Yang, Nankai Lin, Shengyi Jiang


Abstract
In this paper, we report the solution of the team BERT 4EVER for the LT-EDI-2022 shared task2: Homophobia/Transphobia Detection in social media comments in ACL 2022, which aims to classify Youtube comments into one of the following categories: no,moderate, or severe depression. We model the problem as a text classification task and a text generation task and respectively propose two different models for the tasks. To combine the knowledge learned from these two different models, we softly fuse the predicted probabilities of the models above and then select the label with the highest probability as the final output. In addition, multiple augmentation strategies are leveraged to improve the model generalization capability, such as back translation and adversarial training. Experimental results demonstrate the effectiveness of the proposed models and two augmented strategies.
Anthology ID:
2022.ltedi-1.27
Volume:
Proceedings of the Second Workshop on Language Technology for Equality, Diversity and Inclusion
Month:
May
Year:
2022
Address:
Dublin, Ireland
Editors:
Bharathi Raja Chakravarthi, B Bharathi, John P McCrae, Manel Zarrouk, Kalika Bali, Paul Buitelaar
Venue:
LTEDI
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
200–205
Language:
URL:
https://aclanthology.org/2022.ltedi-1.27
DOI:
10.18653/v1/2022.ltedi-1.27
Bibkey:
Cite (ACL):
Xiaotian Lin, Yingwen Fu, Ziyu Yang, Nankai Lin, and Shengyi Jiang. 2022. BERT 4EVER@LT-EDI-ACL2022-Detecting signs of Depression from Social Media:Detecting Depression in Social Media using Prompt-Learning and Word-Emotion Cluster. In Proceedings of the Second Workshop on Language Technology for Equality, Diversity and Inclusion, pages 200–205, Dublin, Ireland. Association for Computational Linguistics.
Cite (Informal):
BERT 4EVER@LT-EDI-ACL2022-Detecting signs of Depression from Social Media:Detecting Depression in Social Media using Prompt-Learning and Word-Emotion Cluster (Lin et al., LTEDI 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.ltedi-1.27.pdf
Video:
 https://aclanthology.org/2022.ltedi-1.27.mp4