StreamCorrect: Self-Supervised Error Correction for Real-Time ASR with Offline Recognizers

Tung D. Vu, Zeying Xie, Weiwei Zhao, Victor Junqiu Wei, Di Jiang, Yi R. Fung


Abstract
Streaming Automatic Speech Recognition (ASR), also known as online or real-time ASR, transcribes speech incrementally while audio is being spoken and is critical for many industry applications. Despite the strong performance of modern offline ASR models, streaming deployment remains challenging because limited future context can cause early recognition errors to propagate across later chunks. We define the task of streaming ASR error correction and propose StreamCorrect, a modular framework that fine-tunes a lightweight error corrector from self-generated streaming ASR errors and integrates it with existing streaming ASR systems. To enable training without human annotation, StreamCorrect introduces a timestamp-free boundary recovery procedure based on Prefix-to-Reference Alignment for generating chunk-level correction data. Across multiple languages and ASR backbones, StreamCorrect achieves up to 39% relative character error rate (CER) reduction with minimal latency overhead. Error propagation analysis further shows increasing benefits over time, with up to 7.2% absolute CER reduction in later audio chunks. StreamCorrect bridges offline ASR models and streaming deployment through a lightweight correction plug-in while preserving the pretrained ASR component without additional tuning or distillation.
Anthology ID:
2026.emnlp-industry.142
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Pepa Atanasova, Gholamreza Haffari, Minghan Wang
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
2391–2403
Language:
URL:
https://aclanthology.org/2026.emnlp-industry.142/
DOI:
Bibkey:
Cite (ACL):
Tung D. Vu, Zeying Xie, Weiwei Zhao, Victor Junqiu Wei, Di Jiang, and Yi R. Fung. 2026. StreamCorrect: Self-Supervised Error Correction for Real-Time ASR with Offline Recognizers. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track, pages 2391–2403, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
StreamCorrect: Self-Supervised Error Correction for Real-Time ASR with Offline Recognizers (Vu et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-industry.142.pdf