Eric Z. Chen
Author directory2026
MultiViewDx: Evidence-Linked Multi-View Clinical Diagnosis
Junda Wang | Zonghai Yao | Yujan Ting | Eric Z. Chen | Hieu Tran | Hong Yu | Weijing Huang | Terrence Chen
Transactions of the Association for Computational Linguistics, Volume 14
Junda Wang | Zonghai Yao | Yujan Ting | Eric Z. Chen | Hieu Tran | Hong Yu | Weijing Huang | Terrence Chen
Transactions of the Association for Computational Linguistics, Volume 14
Medical multimodal large language models (MLLMs) can perform well on existing medical visual question answering (MedVQA) benchmarks, but their training data often does not match clinical diagnosis. Most supervision is organized around isolated images or short QA pairs, leaving two structures weakly specified: how evidence leads to a decision, and how views, series, modalities, and patient context from the same case are linked. We introduce MultiViewDx, a partly physician-validated multimodal instruction dataset for evidence-linked multi-view medical imaging diagnosis. Multi-ViewDx uses the clinical case as the supervision unit. It links imaging studies with patient context, normalizes heterogeneous reports into an evidence-linked workflow (evidence → findings → differential discussion → diagnosis), and uses a unified image-text retriever to constrain instruction synthesis to source-supported evidence. It covers X-ray, CT, MRI, ultrasound, histopathology, and other clinical visual sources. We fine-tune MultiViewDx-8B-AN and evaluate it on both existing MedVQA benchmarks and real-world case-based diagnostic reasoning. Across four MedVQA benchmarks, it achieves the best average accuracy among compared systems (79.0%), outperforming HuatuoGPT-Vision-34B (66.7%) and Claude3-Opus (55.7%). Beyond Med-VQA, on JAMA Clinical Challenge cases, it receives the strongest overall rating under a physician-designed rubric for key clinical points, diagnostic inference, and evidence grounding. Controlled ablations and clinician evaluation show that both case-level multi-view organization and evidence-linked reasoning targets contribute to the gain.1