<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="saha-etal-2026-evaluating">
    <titleInfo>
        <title>Evaluating Bias in Phoneme-Based Automatic Speech Recognition Systems: An Analysis of IPA Transcription Models</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Maneesha</namePart>
        <namePart type="given">Rani</namePart>
        <namePart type="family">Saha</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Catherine</namePart>
        <namePart type="family">Bao</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Neal</namePart>
        <namePart type="family">Patwari</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2026-10</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the IMPACT-SPEECH Workshop: Identifying, Measuring, Preventing, and Assessing Consequences of Bias in Speech LLMs</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Ravi</namePart>
            <namePart type="family">Shekhar</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Monorama</namePart>
            <namePart type="family">Swain</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Jagabandhu</namePart>
            <namePart type="family">Mishra</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Sandipan</namePart>
            <namePart type="family">Dhar</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Haralambos</namePart>
            <namePart type="family">Mouratidis</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Matthew</namePart>
            <namePart type="family">Purver</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Budapest, Hungary</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
        <identifier type="isbn">979-8-89176-479-8</identifier>
    </relatedItem>
    <abstract>As automatic speech recognition (ASR) systems shift toward multilingual support and lowresource language modeling, phoneme-based layers serve as a critical language-agnostic foundation. However, most evaluations of ASR’s demographic biases related to race, age, gender, and accent focus on standard grapheme-based ASR systems with comparatively little emphasis on phoneme-based systems. In this study, we evaluate the performance of WhisperIPA and ZIPA, two state-ofthe-art open-source systems that generate International Phonetic Alphabet (IPA) transcriptions. Our evaluation includes existing multilingual speech corpora and demographically annotated English-language corpora, comparing modelgenerated IPA transcriptions against graphemeto-phoneme (G2P) systems using both standard phoneme error rate (PER) and a proposed Soft PER metric that tolerates linguistically similar phoneme substitutions. Our analysis examines how performance varies across language, gender, accent, ethnicity, and age, revealing persistent disparities even after accounting for acceptable phonemic variation. These findings, while limited, provide insight into potential sources of bias and inform the development of more inclusive and linguistically robust phonemebased ASR systems. Our code and data are publicly available.</abstract>
    <identifier type="citekey">saha-etal-2026-evaluating</identifier>
    <location>
        <url>https://aclanthology.org/2026.impactspeech-1.5/</url>
    </location>
    <part>
        <date>2026-10</date>
        <extent unit="page">
            <start>42</start>
            <end>60</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T Evaluating Bias in Phoneme-Based Automatic Speech Recognition Systems: An Analysis of IPA Transcription Models
%A Saha, Maneesha Rani
%A Bao, Catherine
%A Patwari, Neal
%Y Shekhar, Ravi
%Y Swain, Monorama
%Y Mishra, Jagabandhu
%Y Dhar, Sandipan
%Y Mouratidis, Haralambos
%Y Purver, Matthew
%S Proceedings of the IMPACT-SPEECH Workshop: Identifying, Measuring, Preventing, and Assessing Consequences of Bias in Speech LLMs
%D 2026
%8 October
%I Association for Computational Linguistics
%C Budapest, Hungary
%@ 979-8-89176-479-8
%F saha-etal-2026-evaluating
%X As automatic speech recognition (ASR) systems shift toward multilingual support and lowresource language modeling, phoneme-based layers serve as a critical language-agnostic foundation. However, most evaluations of ASR’s demographic biases related to race, age, gender, and accent focus on standard grapheme-based ASR systems with comparatively little emphasis on phoneme-based systems. In this study, we evaluate the performance of WhisperIPA and ZIPA, two state-ofthe-art open-source systems that generate International Phonetic Alphabet (IPA) transcriptions. Our evaluation includes existing multilingual speech corpora and demographically annotated English-language corpora, comparing modelgenerated IPA transcriptions against graphemeto-phoneme (G2P) systems using both standard phoneme error rate (PER) and a proposed Soft PER metric that tolerates linguistically similar phoneme substitutions. Our analysis examines how performance varies across language, gender, accent, ethnicity, and age, revealing persistent disparities even after accounting for acceptable phonemic variation. These findings, while limited, provide insight into potential sources of bias and inform the development of more inclusive and linguistically robust phonemebased ASR systems. Our code and data are publicly available.
%U https://aclanthology.org/2026.impactspeech-1.5/
%P 42-60

Markdown (Informal)

[Evaluating Bias in Phoneme-Based Automatic Speech Recognition Systems: An Analysis of IPA Transcription Models](https://aclanthology.org/2026.impactspeech-1.5/) (Saha et al., IMPACT-SPEECH 2026)

• Evaluating Bias in Phoneme-Based Automatic Speech Recognition Systems: An Analysis of IPA Transcription Models (Saha et al., IMPACT-SPEECH 2026)

ACL

• Maneesha Rani Saha, Catherine Bao, and Neal Patwari. 2026. Evaluating Bias in Phoneme-Based Automatic Speech Recognition Systems: An Analysis of IPA Transcription Models. In Proceedings of the IMPACT-SPEECH Workshop: Identifying, Measuring, Preventing, and Assessing Consequences of Bias in Speech LLMs, pages 42–60, Budapest, Hungary. Association for Computational Linguistics.