Towards Fluid Consultations: Design and Real-World Evaluation of a Multi-Agent, Full-Duplex Health AI Assistant

Zhoujian Sun, Minghui Yang, Jian Wang, Jinjie Gu, Junwei Liu


Abstract
Access to reliable health consultation is a critical global challenge. While large language models show promise, their practical utility is typically limited by high input barriers, lack of adaptive response strategies for complex scenarios, and insufficient real-world evaluation. To address these gaps, we present a novel health AI assistant that integrates a low-latency full-duplex voice interface with a Multi-Agent System (MAS). The full-duplex design supports natural turn-taking, significantly lowering interaction barriers and quadrupling average conversation depth from 2.62 to 10.16 turns compared to text-based baselines. Furthermore, our MAS architecture decouples clinical reasoning from general conversation, effectively managing complex queries and boosting clinical performance scores by over 30% compared to single-agent baselines. We conducted the first large-scale analysis of an LLM-based health assistant deployed to the general public (N > 5,000), demonstrating superior user engagement and providing empirical evidence on the safety and utility of deploying such systems in realistic environments.
Anthology ID:
2026.emnlp-industry.36
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Pepa Atanasova, Gholamreza Haffari, Minghan Wang
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
610–625
Language:
URL:
https://aclanthology.org/2026.emnlp-industry.36/
DOI:
Bibkey:
Cite (ACL):
Zhoujian Sun, Minghui Yang, Jian Wang, Jinjie Gu, and Junwei Liu. 2026. Towards Fluid Consultations: Design and Real-World Evaluation of a Multi-Agent, Full-Duplex Health AI Assistant. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track, pages 610–625, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Towards Fluid Consultations: Design and Real-World Evaluation of a Multi-Agent, Full-Duplex Health AI Assistant (Sun et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-industry.36.pdf