Hamees Sayed
Author directory2026
The Anatomy of an ASR Hallucination
Hamees Sayed | Apoorv Singh | Kumar Aman | Akshat Mandloi
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Hamees Sayed | Apoorv Singh | Kumar Aman | Akshat Mandloi
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
ASR systems sometimes produce fluent text that is unrelated to the speech they receive. We view these hallucinations as one possible consequence of a broader grounding failure, in which the transcript is no longer adequately guided by the audio. To understand where this failure becomes possible, we study two independently trained Conformer-Large recognizers — one CTC and one RNN-T — under environmental degradation and speaker-background shift. In both models, the final encoder stage emerges as a critical boundary: bypassing the final block causes divergence on nearly every utterance, whereas bypassing middle blocks has little effect. At this same stage, the representations become more compact, text becomes readable by the trained decoder, and grapheme information becomes explicit. Importantly, the intervention produces garbled or repetitive output rather than fluent fabrication (0 of 354 judged outputs). Our result therefore identifies a mechanistic precondition for hallucination — the failure to produce adequately grounded output — not the complete origin of naturally occurring hallucinations. Together, the results reveal a consistent terminal-stage dependency for grounded recognition across two decoder families and multiple distribution shifts.
2024
SPRING Lab IITM’s Submission to Low Resource Indic Language Translation Shared Task
Hamees Sayed | Advait Joglekar | Srinivasan Umesh
Proceedings of the Ninth Conference on Machine Translation
Hamees Sayed | Advait Joglekar | Srinivasan Umesh
Proceedings of the Ninth Conference on Machine Translation
We develop a robust translation model for four low-resource Indic languages: Khasi, Mizo, Manipuri, and Assamese. Our approach includes a comprehensive pipeline from data collection and preprocessing to training and evaluation, leveraging data from WMT task datasets, BPCC, PMIndia, and OpenLanguageData. To address the scarcity of bilingual data, we use back-translation techniques on monolingual datasets for Mizo and Khasi, significantly expanding our training corpus. We fine-tune the pre-trained NLLB 3.3B model for Assamese, Mizo, and Manipuri, achieving improved performance over the baseline. For Khasi, which is not supported by the NLLB model, we introduce special tokens and train the model on our Khasi corpus. Our training involves masked language modelling, followed by fine-tuning for English-to-Indic and Indic-to-English translations.