Keeping the Ums: Conversation-Analysis-Informed Verbatim ASR for Web Speech

Steven Coats


Abstract
Web video makes massive spoken-language corpora possible, but automatic speech recognition (ASR) routinely normalizes away fillers, repetitions, repairs, and hesitations. Because Conversation Analysis (CA) transcripts meticulously document these interactional phenomena, they offer an ideal yet underutilized resource for ASR adaptation. We show that fine-tuning Whisper large-v3 on just 4.47 hours of CA-annotated Australian and US conversation dramatically improves verbatim transcription on heterogeneous web speech without sacrificing lexical accuracy. On a 57-clip benchmark from 39 Australian and New Zealand local-government channels, fine-tuning reduces verbatim word error rate from 16.06% to 11.39% (a 29% relative reduction) and raises filler recovery F1 from .117 to .819. These gains transfer directly to New Zealand speech absent from training (reducing verbatim error from 18.24% to 11.71%), demonstrating that small CA datasets teach the model a generalizable transcription policy rather than narrow acoustic memorization. We argue that targeted verbatim adaptation should become standard practice in web-as-corpus pipelines to ensure large-scale resources like CoANZSE preserve the interactional evidence needed for linguistic research.
Anthology ID:
2026.wac-1.18
Volume:
Proceedings of the 13th Web-as-Corpus Workshop
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Pedro Ortiz Suarez, Laurie Burchell, Nikola Ljubešić, Yves Scherrer, Veronika Laippala, Vuk Dinić, Thom Vaughan
Venues:
WAC | WS
SIG:
SIGWAC
Publisher:
Association for Computational Linguistics
Note:
Pages:
192–199
Language:
URL:
https://aclanthology.org/2026.wac-1.18/
DOI:
Bibkey:
Cite (ACL):
Steven Coats. 2026. Keeping the Ums: Conversation-Analysis-Informed Verbatim ASR for Web Speech. In Proceedings of the 13th Web-as-Corpus Workshop, pages 192–199, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Keeping the Ums: Conversation-Analysis-Informed Verbatim ASR for Web Speech (Coats, WAC 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.wac-1.18.pdf