When Patients Cut In: Extending Clinical Conversational AI Safety to Interruptions

Zachary Ellis, Spencer Hazel, Adam Brandt, Ernest Lim, Yajie Vera He, Jared Joselowitz


Abstract
Clinical voice agents are now deployed in routine care, where real patients do not wait their turn: they interrupt. These systems typically use a cascaded architecture (speech-to-text → LLM → text-to-speech), so when a patient cuts the agent off mid utterance, clinically required content can be lost even when the model handles cooperative transcripts well. Yet clinical conversational-AI benchmarks almost universally assume patients wait for the agent to finish, missing interruption-induced loss of required content. We present a transcript-based evaluation of interruption recovery, adapting conversation-analytic overlap categories into three operational types (recognitional, competitive, transitional sub-unit) and testing four deployment-oriented, non-reasoning LLM configurations across four cells spanning history-taking (information gathering) and FAQ (information provision), scored on whether the agent preserves the clinically required content. In the gathering cells, target-question failure varied across models; in the provision cells, where arms are directly comparable, failure rose for every model. Rankings differ across cells, and competitive FAQ interruption produced 30/30 provision-coverage failures for all four models (Wilson 95% CI: 88.6–100.0%; baseline 0/30 for three, 4/30 for Llama). A brief apology marker (“sorry to interrupt”) shifts recovery by tens of percentage points, inconsistently across models, and for one it reduces recovery. Interruption robustness therefore cannot be a single score: evaluation must be content-grounded, reported per cell, and matched to the deployment’s interruption profile.
Anthology ID:
2026.findings-emnlp.2456
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
52828–52852
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.2456/
DOI:
Bibkey:
Cite (ACL):
Zachary Ellis, Spencer Hazel, Adam Brandt, Ernest Lim, Yajie Vera He, and Jared Joselowitz. 2026. When Patients Cut In: Extending Clinical Conversational AI Safety to Interruptions. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 52828–52852, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
When Patients Cut In: Extending Clinical Conversational AI Safety to Interruptions (Ellis et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.2456.pdf