Not All Acoustic Frames Contribute Equally: Frame-Selective Acoustic Conditioning for Dysarthric ASR Correction

Gyutae Park, Ji-Hwan Kim


Abstract
Not all acoustic frames are equally useful for correcting dysarthric ASR errors. In dysarthric speech, acoustic deviations are unevenly distributed across frames, but LLM-based generative error correction systems often inject acoustic features uniformly, under-emphasizing deviant frames and over-correcting reliable ones. We propose a frame-selective acoustic conditioning method driven by a Frame Deviation Score (FDS) and VGate. FDS is a control-referenced per-frame deviation score computed over Whisper encoder frames, and VGate uses standardized per-frame FDS to reweight acoustic value vectors. Across ten personalized TORGO settings, we compare VGate with Plain, an acoustic-adapter baseline without the VGate gating module, and show that VGate is conditional rather than universally beneficial. Three findings support conditional use. (1) Plain residual headroom (the gap between Plain and Oracle@5 WER) and utterance-mean FDS-DIV characterize high-benefit cases, with gains concentrated in ref-preserved and overgeneration cases and the largest improvements driven by insertion control. (2) A development-calibrated FDS-DIV router lowers pooled WER from 19.55% to 18.29% while routing only 20.72% of utterances. (3) Cross-corpus COPAS results and blinded listening further support this conditional-use strategy. Our code is publicly available at https://github.com/doraemon500/FSAC.
Anthology ID:
2026.findings-emnlp.409
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
8638–8657
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.409/
DOI:
Bibkey:
Cite (ACL):
Gyutae Park and Ji-Hwan Kim. 2026. Not All Acoustic Frames Contribute Equally: Frame-Selective Acoustic Conditioning for Dysarthric ASR Correction. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 8638–8657, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Not All Acoustic Frames Contribute Equally: Frame-Selective Acoustic Conditioning for Dysarthric ASR Correction (Park & Kim, Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.409.pdf