Shama Gupta
Author directory2026
CoSE-E: A Benchmark for Code-switched Speech Evaluation in Enterprise Settings
Shama Gupta | Hoang H Nguyen | Chelsea Huang | Lindsay Devon Brin | Fanny Riols
The Proceedings of Speech and Audio Language Models Workshop (2nd Edition)
Shama Gupta | Hoang H Nguyen | Chelsea Huang | Lindsay Devon Brin | Fanny Riols
The Proceedings of Speech and Audio Language Models Workshop (2nd Edition)
Code-switching (CS), a seamless alternation between languages within a single utterance, remains a critical challenge in automatic speech recognition (ASR). While prior works focus on conversational CS-ASR, enterprise settings demand evaluation of operational impact beyond edit-distance errors: how code-switching transcription errors propagate to downstream voice agent task failures. In this work, we propose (1) a CS-ASR synthetic benchmark and multidimensional evaluation framework tailored to enterprise domains, (2) systematic evaluation of frontier ASR systems across 5 language pairs, (3) diagnostic analysis of the additional transcription errors that code-switching introduces across language pairs and models. We release CoSE-E to support enterprise-focused CS-ASR evaluation for multilingual voice agents in enterprise deployment.