Renwei Xiao
Author directory2026
Beyond Static EHRs: Dynamic Examination Feedback for LLM-based Virtual Patients
Renwei Xiao | Wen He | Hongzhou Yu | Qingqiu Li | Yuejie Zhang | Rui Feng | Xiaobo Zhang
Findings of the Association for Computational Linguistics: EMNLP 2026
Renwei Xiao | Wen He | Hongzhou Yu | Qingqiu Li | Yuejie Zhang | Rui Feng | Xiaobo Zhang
Findings of the Association for Computational Linguistics: EMNLP 2026
Large language models (LLMs) have shown significant promise in healthcare applications. To better mirror real-world settings for LLM evaluation, dynamic longitudinal diagnosis-and-treatment simulation with virtual patients has recently emerged as a focal point of research. However, existing simulation frameworks are limited by clinical trajectory uniqueness, where virtual patients can only provide feedback based on information available in static electronic health records (EHRs). This limitation leads to simulation failures when unrecorded but medically sound examinations are ordered. In this paper, we formulate the task of Examination Feedback Simulation, which aims to dynamically augment the unique trajectory by simulating medically plausible examination results in response to clinical orders. To support this largely unexplored research area, we construct ClinTrack, a dataset curated from MIMIC-IV. We further propose a structure-aware evaluation metric SimScore to quantitatively assess the quality of simulated results, which shows promising initial alignment with expert judgment. Building on this framework, we develop ClinSim, a tailored generative model for this task. Experiments demonstrate that our 4B ClinSim model significantly outperforms flagship models with up to 235B parameters on this task, providing a critical foundation for creating more dynamic and realistic virtual patients. Code and other resources are available at GitHub.