Automatic Detection of Incoherent Speech for Diagnosing Schizophrenia

Dan Iter, Jong Yoon, Dan Jurafsky


Abstract
Schizophrenia is a mental disorder which afflicts an estimated 0.7% of adults world wide. It affects many areas of mental function, often evident from incoherent speech. Diagnosing schizophrenia relies on subjective judgments resulting in disagreements even among trained clinicians. Recent studies have proposed the use of natural language processing for diagnosis by drawing on automatically-extracted linguistic features like discourse coherence and lexicon. Here, we present the first benchmark comparison of previously proposed coherence models for detecting symptoms of schizophrenia and evaluate their performance on a new dataset of recorded interviews between subjects and clinicians. We also present two alternative coherence metrics based on modern sentence embedding techniques that outperform the previous methods on our dataset. Lastly, we propose a novel computational model for reference incoherence based on ambiguous pronoun usage and show that it is a highly predictive feature on our data. While the number of subjects is limited in this pilot study, our results suggest new directions for diagnosing common symptoms of schizophrenia.
Anthology ID:
W18-0615
Volume:
Proceedings of the Fifth Workshop on Computational Linguistics and Clinical Psychology: From Keyboard to Clinic
Month:
June
Year:
2018
Address:
New Orleans, LA
Editors:
Kate Loveys, Kate Niederhoffer, Emily Prud’hommeaux, Rebecca Resnik, Philip Resnik
Venue:
CLPsych
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
136–146
Language:
URL:
https://aclanthology.org/W18-0615
DOI:
10.18653/v1/W18-0615
Bibkey:
Cite (ACL):
Dan Iter, Jong Yoon, and Dan Jurafsky. 2018. Automatic Detection of Incoherent Speech for Diagnosing Schizophrenia. In Proceedings of the Fifth Workshop on Computational Linguistics and Clinical Psychology: From Keyboard to Clinic, pages 136–146, New Orleans, LA. Association for Computational Linguistics.
Cite (Informal):
Automatic Detection of Incoherent Speech for Diagnosing Schizophrenia (Iter et al., CLPsych 2018)
Copy Citation:
PDF:
https://aclanthology.org/W18-0615.pdf