DocCHA: Towards LLM-Augmented Interactive Online diagnosis System

Xinyi Liu, Dachun Sun, Yi Fung, Dilek Hakkani-Tur, Tarek F. Abdelzaher


Abstract
Despite the impressive capabilities of Large Language Models (LLMs), existing Conversational Health Agents (CHAs) remain static and brittle, incapable of adaptive multi-turn reasoning, symptom clarification, or transparent decision-making. This hinders their real-world applicability in clinical diagnosis, where iterative and structured dialogue is essential. We propose DocCHA, a confidence-aware, modular framework that emulates clinical reasoning by decomposing the diagnostic process into three stages: (1) symptom elicitation, (2) history acquisition, and (3) causal graph construction. Each module uses interpretable confidence scores to guide adaptive questioning, prioritize informative clarifications, and refine weak reasoning links. Evaluated on two real-world Chinese consultation datasets (IMCS21, DX), DocCHA consistently outperforms strong prompting-based LLM baselines (GPT-3.5, GPT-4o, LLaMA-3), achieving up to 5.18% higher diagnostic accuracy and over 30% improvement in symptom recall, with only modest increase in dialogue turns. These results demonstrate DocCHA’s effectiveness in enabling structured, transparent, and efficient diagnostic conversations—paving the way for trustworthy LLM-powered clinical assistants in multilingual and resource-constrained settings.
Anthology ID:
2025.sigdial-1.49
Volume:
Proceedings of the 26th Annual Meeting of the Special Interest Group on Discourse and Dialogue
Month:
August
Year:
2025
Address:
Avignon, France
Editors:
Frédéric Béchet, Fabrice Lefèvre, Nicholas Asher, Seokhwan Kim, Teva Merlin
Venue:
SIGDIAL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
609–619
Language:
URL:
https://aclanthology.org/2025.sigdial-1.49/
DOI:
Bibkey:
Cite (ACL):
Xinyi Liu, Dachun Sun, Yi Fung, Dilek Hakkani-Tur, and Tarek F. Abdelzaher. 2025. DocCHA: Towards LLM-Augmented Interactive Online diagnosis System. In Proceedings of the 26th Annual Meeting of the Special Interest Group on Discourse and Dialogue, pages 609–619, Avignon, France. Association for Computational Linguistics.
Cite (Informal):
DocCHA: Towards LLM-Augmented Interactive Online diagnosis System (Liu et al., SIGDIAL 2025)
Copy Citation:
PDF:
https://aclanthology.org/2025.sigdial-1.49.pdf