Enhancing ASR-based error analysis for atypical speech: post hoc integration of aphasic and dialectal phonetic features

Eugenia Rykova, Elisabeth Zeuner, Susanne Voigt-Zimmermann, Mathias Walther


Abstract
Despite current progress, automatic speech recognition (ASR) often struggles with non-standard speech, for example, influenced by dialectal or pathological features. (Re)training ASR models to accommodate these variations is not always possible due to limited data. This paper proposes applying the knowledge about non-standard (aphasic and dialectal) phonetic features to the ASR transcription post hoc. Using speech data from German speakers with aphasia who speak the Thuringian-Upper Saxon dialect, this study evaluates the impact of these modifications on an ASR-based error analysis pipeline. The approach helps to reduce automatic error rates on the recordings manually labelled as error-free. The performance of the pipeline also improves both in general acceptance or rejection of the responses and error attribution. General acceptance/rejection accuracy reaches the mean of 83.3%, which is considered sufficient to be used in a digital application for speech and language therapy support.
Anthology ID:
2025.jlcl-1.3
Volume:
Journal for Language Technology and Computational Linguistics, Vol. 38 No. 1
Month:
December
Year:
2025
Address:
Editor:
Christian Wartena
Venue:
JLCL
SIG:
Publisher:
German Society for Computational Linguistics and Language Technology
Note:
Pages:
37–62
Language:
URL:
https://aclanthology.org/2025.jlcl-1.3/
DOI:
10.21248/jlcl.38.2025.251
Bibkey:
Cite (ACL):
Eugenia Rykova, Elisabeth Zeuner, Susanne Voigt-Zimmermann, and Mathias Walther. 2025. Enhancing ASR-based error analysis for atypical speech: post hoc integration of aphasic and dialectal phonetic features. Journal for Language Technology and Computational Linguistics, 38(1):37–62.
Cite (Informal):
Enhancing ASR-based error analysis for atypical speech: post hoc integration of aphasic and dialectal phonetic features (Rykova et al., JLCL 2025)
Copy Citation:
PDF:
https://aclanthology.org/2025.jlcl-1.3.pdf