Temporal Taxation Compounds Under Post-Training Compression of Whisper Models

Srishti Ginjala, Eric Fosler-Lussier, Christopher W. Myers, Srinivasan Parthasarathy


Abstract
Automatic speech recognition models are audited for demographic fairness at full precision, yet the models that ship to production have been quantized, pruned, and distilled. We ask whether post-training weight compression, which alters model weights rather than the audio signal or its feature representation, redistributes error burden across demographic groups. Across the Whisper family on FairSpeech, Common Voice 25, and AfriSpeech200, 50% Wanda pruning of Whisper-largev3 sharply widens the Black/AA-vs-Asian temporal-taxation differential on Fair-Speech: the absolute word-error-rate gap between the worst- and best-served groups more than doubles; at an assumed cost of five seconds of correction effort per transcription error this is a rise from 30 to 64 seconds of correction time per minute of speech. This +111% relative increase is invariant to the assumed per-error cost, survives an audio-quality control, and is only partly mitigated by beam-search decoding, which still leaves an +86% increase. At edge model size, INT4 HQQ quantization compounds catastrophic transcript loops on West African accents by factors of five to seven. Distillation, by contrast, narrows demographic gaps in 21 of 27 evaluated settings (teacherstudent pair, precision, and dataset), with the exceptions concentrated on a single model pair. We cast the temporal-taxation construct of Choi and Choi (2025) as a quantitative metric, and show that single-snapshot fairness audits on full-precision models do not capture the deployment-time burden that compression places on already-marginalized speakers.
Anthology ID:
2026.impactspeech-1.8
Volume:
Proceedings of the IMPACT-SPEECH Workshop: Identifying, Measuring, Preventing, and Assessing Consequences of Bias in Speech LLMs
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Ravi Shekhar, Monorama Swain, Jagabandhu Mishra, Sandipan Dhar, Haralambos Mouratidis, Matthew Purver
Venues:
IMPACT-SPEECH | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
81–94
Language:
URL:
https://aclanthology.org/2026.impactspeech-1.8/
DOI:
Bibkey:
Cite (ACL):
Srishti Ginjala, Eric Fosler-Lussier, Christopher W. Myers, and Srinivasan Parthasarathy. 2026. Temporal Taxation Compounds Under Post-Training Compression of Whisper Models. In Proceedings of the IMPACT-SPEECH Workshop: Identifying, Measuring, Preventing, and Assessing Consequences of Bias in Speech LLMs, pages 81–94, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Temporal Taxation Compounds Under Post-Training Compression of Whisper Models (Ginjala et al., IMPACT-SPEECH 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.impactspeech-1.8.pdf