Pronunciation scoring for dysarthric speakers with DNN-HMM based goodness of pronunciation (GoP) measure

Shruti Jeyaraman, Anantha K. Krishnan, Vijayalakshmi P, Nagarajan T


Abstract
Dysarthria is a neurological motor disorder caused by cranial damage that interferes with the muscles involved in the correct pronunciation of sounds and intelligible speech. Computer Aided Pronunciation training (CAPT) systems traditionally used for the pronunciation assessment of L2 language learners can offer a method to detect and score mispronounced sounds in dysarthric speakers as a way of evaluation without human intervention. In this work, a phonetic level DNN-HMM based Goodness of Pronunciation (GoP) for pronunciation scoring, on native Tamil Dysarthric speakers corpus is presented. The scores are calculated using the posteriors of the subphonemic elements called senones with a focus on their prevalence across phones and their transitions across HMM states. The phonetic-level scores obtained for speakers of different levels of severity help establish speaker-specific trends in pronunciation through an objective log-likelihood metric, in contrast to subjective evaluations by Speech Language Therapists (SLTs).
Anthology ID:
2024.icon-1.73
Volume:
Proceedings of the 21st International Conference on Natural Language Processing (ICON)
Month:
December
Year:
2024
Address:
AU-KBC Research Centre, Chennai, India
Editors:
Sobha Lalitha Devi, Karunesh Arora
Venue:
ICON
SIG:
Publisher:
NLP Association of India (NLPAI)
Note:
Pages:
616–620
Language:
URL:
https://aclanthology.org/2024.icon-1.73/
DOI:
Bibkey:
Cite (ACL):
Shruti Jeyaraman, Anantha K. Krishnan, Vijayalakshmi P, and Nagarajan T. 2024. Pronunciation scoring for dysarthric speakers with DNN-HMM based goodness of pronunciation (GoP) measure. In Proceedings of the 21st International Conference on Natural Language Processing (ICON), pages 616–620, AU-KBC Research Centre, Chennai, India. NLP Association of India (NLPAI).
Cite (Informal):
Pronunciation scoring for dysarthric speakers with DNN-HMM based goodness of pronunciation (GoP) measure (Jeyaraman et al., ICON 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.icon-1.73.pdf