Catherine Bao
Author directory2026
Evaluating Bias in Phoneme-Based Automatic Speech Recognition Systems: An Analysis of IPA Transcription Models
Maneesha Rani Saha | Catherine Bao | Neal Patwari
Proceedings of the IMPACT-SPEECH Workshop: Identifying, Measuring, Preventing, and Assessing Consequences of Bias in Speech LLMs
Maneesha Rani Saha | Catherine Bao | Neal Patwari
Proceedings of the IMPACT-SPEECH Workshop: Identifying, Measuring, Preventing, and Assessing Consequences of Bias in Speech LLMs
As automatic speech recognition (ASR) systems shift toward multilingual support and lowresource language modeling, phoneme-based layers serve as a critical language-agnostic foundation. However, most evaluations of ASR’s demographic biases related to race, age, gender, and accent focus on standard grapheme-based ASR systems with comparatively little emphasis on phoneme-based systems. In this study, we evaluate the performance of WhisperIPA and ZIPA, two state-ofthe-art open-source systems that generate International Phonetic Alphabet (IPA) transcriptions. Our evaluation includes existing multilingual speech corpora and demographically annotated English-language corpora, comparing modelgenerated IPA transcriptions against graphemeto-phoneme (G2P) systems using both standard phoneme error rate (PER) and a proposed Soft PER metric that tolerates linguistically similar phoneme substitutions. Our analysis examines how performance varies across language, gender, accent, ethnicity, and age, revealing persistent disparities even after accounting for acceptable phonemic variation. These findings, while limited, provide insight into potential sources of bias and inform the development of more inclusive and linguistically robust phonemebased ASR systems. Our code and data are publicly available.
Empirically Grounded Behavioral Adaptivity for LLM-Based Virtual Patients in Psychotherapy Training
Angela Chen | Siwei Jin | Catherine Bao | Canwen Wang | Yi-Chia Wang | Robert E. Kraut | Tongshuang Wu | Haiyi Zhu
Findings of the Association for Computational Linguistics: EMNLP 2026
Angela Chen | Siwei Jin | Catherine Bao | Canwen Wang | Yi-Chia Wang | Robert E. Kraut | Tongshuang Wu | Haiyi Zhu
Findings of the Association for Computational Linguistics: EMNLP 2026
Simulated patients offer a scalable way to train psychotherapy micro-skills such as empathic responding and exploratory probing, but current systems either follow fixed scripts or rely on LLMs that drift unpredictably over long sessions. We present the Adaptive Virtual Patient (AVP), which adapts its disclosure behavior in response to trainee skill, from guarded, through moderate openness, to full disclosure. The AVP is informed by a structural equation model fit to nearly 2000 hours of real-world psychotherapy transcripts, which quantifies how therapist empathy and exploration shift a patient’s openness over time. An LLM generates the AVP’s utterances conditioned on a disclosure level that the dynamics module updates each turn. In an evaluation with 20 clinicians and trainees over 80 sessions (1,033 turns), the AVP’s disclosure rises in response to therapist empathy and exploration, while a prompt-only baseline stays flat; ablations confirm that the empirically motivated parameterization outperforms alternatives, with exploration carrying most of the adaptive signal.