A Multi-Persona Chatbot for Hotline Counselor Training

Orianna Demasi, Yu Li, Zhou Yu


Abstract
Suicide prevention hotline counselors aid individuals during difficult times through millions of calls and chats. A chatbot cannot safely replace a counselor, but we explore whether a chatbot can be developed to help train human counselors. Such a system needs to simulate intimate situations across multiple practice sessions. Open-domain dialogue systems frequently suffer from generic responses that do not characterize personal stories, so we look to infuse conversations with persona information by mimicking prototype conversations. Towards building a “Crisisbot” hotline visitor simulation, we propose a counseling strategy annotation scheme and a multi-task framework that leverages these counselor strategies to retrieve similar examples, generate diverse sub-utterances, and interleave prototype and generated sub-utterances into complex responses. We evaluate this framework with crowdworkers and experienced hotline counselors. The framework considerably increases response diversity and specificity, with limited impact to coherence. Our results also show a considerable discrepancy between crowdworker and counselor judgements, which emphasizes the importance of including target populations in system development and evaluation.
Anthology ID:
2020.findings-emnlp.324
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2020
Month:
November
Year:
2020
Address:
Online
Editors:
Trevor Cohn, Yulan He, Yang Liu
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
3623–3636
Language:
URL:
https://aclanthology.org/2020.findings-emnlp.324
DOI:
10.18653/v1/2020.findings-emnlp.324
Bibkey:
Cite (ACL):
Orianna Demasi, Yu Li, and Zhou Yu. 2020. A Multi-Persona Chatbot for Hotline Counselor Training. In Findings of the Association for Computational Linguistics: EMNLP 2020, pages 3623–3636, Online. Association for Computational Linguistics.
Cite (Informal):
A Multi-Persona Chatbot for Hotline Counselor Training (Demasi et al., Findings 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.findings-emnlp.324.pdf