On the Utility of Audiovisual Dialog Technologies and Signal Analytics for Real-time Remote Monitoring of Depression Biomarkers

Michael Neumann, Oliver Roessler, David Suendermann-Oeft, Vikram Ramanarayanan


Abstract
We investigate the utility of audiovisual dialog systems combined with speech and video analytics for real-time remote monitoring of depression at scale in uncontrolled environment settings. We collected audiovisual conversational data from participants who interacted with a cloud-based multimodal dialog system, and automatically extracted a large set of speech and vision metrics based on the rich existing literature of laboratory studies. We report on the efficacy of various audio and video metrics in differentiating people with mild, moderate and severe depression, and discuss the implications of these results for the deployment of such technologies in real-world neurological diagnosis and monitoring applications.
Anthology ID:
2020.nlpmc-1.7
Volume:
Proceedings of the First Workshop on Natural Language Processing for Medical Conversations
Month:
July
Year:
2020
Address:
Online
Editors:
Parminder Bhatia, Steven Lin, Rashmi Gangadharaiah, Byron Wallace, Izhak Shafran, Chaitanya Shivade, Nan Du, Mona Diab
Venue:
NLPMC
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
47–52
Language:
URL:
https://aclanthology.org/2020.nlpmc-1.7
DOI:
10.18653/v1/2020.nlpmc-1.7
Bibkey:
Cite (ACL):
Michael Neumann, Oliver Roessler, David Suendermann-Oeft, and Vikram Ramanarayanan. 2020. On the Utility of Audiovisual Dialog Technologies and Signal Analytics for Real-time Remote Monitoring of Depression Biomarkers. In Proceedings of the First Workshop on Natural Language Processing for Medical Conversations, pages 47–52, Online. Association for Computational Linguistics.
Cite (Informal):
On the Utility of Audiovisual Dialog Technologies and Signal Analytics for Real-time Remote Monitoring of Depression Biomarkers (Neumann et al., NLPMC 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.nlpmc-1.7.pdf
Video:
 http://slideslive.com/38929892