Detecting Dementia from Long Neuropsychological Interviews

Nauman Dawalatabad, Yuan Gong, Sameer Khurana, Rhoda Au, James Glass


Abstract
Neuropsychological exams are commonly used to diagnose various kinds of cognitive impairment. They typically involve a trained examiner who conducts a series of cognitive tests with a subject. In recent years, there has been growing interest in developing machine learning methods to extract speech and language biomarkers from exam recordings to provide automated input for cognitive assessment. Inspired by recent findings suggesting that the examiner’s language can influence cognitive impairment classifications, in this paper, we study the influence of the examiner on automatic dementia identification decisions in real-world neuropsychological exams. To mitigate the influence of the examiner, we propose a systematic three-stage pipeline for detecting dementia from exam recordings. In the first stage, we perform audio-based speaker diarization (i.e., estimating who spoke when?) by incorporating speaker discriminative features. In the second stage, we employ text-based language models to identify the role of the speaker (i.e., examiner or subject). Finally, in the third stage, we employ text- and audio-based models to detect cognitive impairment from hypothesized subject segments. Our studies suggest that incorporating audio-based diarization followed by text-based role identification helps mitigate the influences from the examiner’s segments. Further, we found that the text and audio modalities complement each other, and the performance improves when we use both modalities. We also perform several carefully designed experimental studies to assess the performance of each stage.
Anthology ID:
2022.findings-emnlp.386
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2022
Month:
December
Year:
2022
Address:
Abu Dhabi, United Arab Emirates
Editors:
Yoav Goldberg, Zornitsa Kozareva, Yue Zhang
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
5270–5283
Language:
URL:
https://aclanthology.org/2022.findings-emnlp.386
DOI:
10.18653/v1/2022.findings-emnlp.386
Bibkey:
Cite (ACL):
Nauman Dawalatabad, Yuan Gong, Sameer Khurana, Rhoda Au, and James Glass. 2022. Detecting Dementia from Long Neuropsychological Interviews. In Findings of the Association for Computational Linguistics: EMNLP 2022, pages 5270–5283, Abu Dhabi, United Arab Emirates. Association for Computational Linguistics.
Cite (Informal):
Detecting Dementia from Long Neuropsychological Interviews (Dawalatabad et al., Findings 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.findings-emnlp.386.pdf
Video:
 https://aclanthology.org/2022.findings-emnlp.386.mp4