W. Jim Zheng
2022
Conversational Bots for Psychotherapy: A Study of Generative Transformer Models Using Domain-specific Dialogues
Avisha Das
|
Salih Selek
|
Alia R. Warner
|
Xu Zuo
|
Yan Hu
|
Vipina Kuttichi Keloth
|
Jianfu Li
|
W. Jim Zheng
|
Hua Xu
Proceedings of the 21st Workshop on Biomedical Language Processing
Conversational bots have become non-traditional methods for therapy among individuals suffering from psychological illnesses. Leveraging deep neural generative language models, we propose a deep trainable neural conversational model for therapy-oriented response generation. We leverage transfer learning methods during training on therapy and counseling based data from Reddit and AlexanderStreet. This was done to adapt existing generative models – GPT2 and DialoGPT – to the task of automated dialog generation. Through quantitative evaluation of the linguistic quality, we observe that the dialog generation model - DialoGPT (345M) with transfer learning on video data attains scores similar to a human response baseline. However, human evaluation of responses by conversational bots show mostly signs of generic advice or information sharing instead of therapeutic interaction.
Search
Co-authors
- Avisha Das 1
- Salih Selek 1
- Alia R. Warner 1
- Xu Zuo 1
- Yan Hu 1
- show all...