A Risk-Averse Mechanism for Suicidality Assessment on Social Media

Ramit Sawhney, Atula Neerkaje, Manas Gaur


Abstract
Recent studies have shown that social media has increasingly become a platform for users to express suicidal thoughts outside traditional clinical settings. With advances in Natural Language Processing strategies, it is now possible to design automated systems to assess suicide risk. However, such systems may generate uncertain predictions, leading to severe consequences. We hence reformulate suicide risk assessment as a selective prioritized prediction problem over the Columbia Suicide Severity Risk Scale (C-SSRS). We propose SASI, a risk-averse and self-aware transformer-based hierarchical attention classifier, augmented to refrain from making uncertain predictions. We show that SASI is able to refrain from 83% of incorrect predictions on real-world Reddit data. Furthermore, we discuss the qualitative, practical, and ethical aspects of SASI for suicide risk assessment as a human-in-the-loop framework.
Anthology ID:
2022.acl-short.70
Volume:
Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)
Month:
May
Year:
2022
Address:
Dublin, Ireland
Editors:
Smaranda Muresan, Preslav Nakov, Aline Villavicencio
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
628–635
Language:
URL:
https://aclanthology.org/2022.acl-short.70
DOI:
10.18653/v1/2022.acl-short.70
Bibkey:
Cite (ACL):
Ramit Sawhney, Atula Neerkaje, and Manas Gaur. 2022. A Risk-Averse Mechanism for Suicidality Assessment on Social Media. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pages 628–635, Dublin, Ireland. Association for Computational Linguistics.
Cite (Informal):
A Risk-Averse Mechanism for Suicidality Assessment on Social Media (Sawhney et al., ACL 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.acl-short.70.pdf