Yining Yuan
Author directory2026
PROVENA-MED: Benchmarking Provenance Faithfulness in Multimodal Clinical Reasoning
J. Ben Tamo | Yining Yuan | Benoit Louis Marteau | Micky C. Nnamdi | Yuxing Lu | May Dongmei Wang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
J. Ben Tamo | Yining Yuan | Benoit Louis Marteau | Micky C. Nnamdi | Yuxing Lu | May Dongmei Wang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Clinical language and vision-language models increasingly generate diagnostic and treatment rationales, but those claims remain difficult to audit. Existing benchmarks usually score final answers over fully revealed records, without testing whether each claim is grounded in valid patient evidence or whether models can seek missing information efficiently. We introduce Provena-Med, a benchmark for evaluating provenance-faithful multimodal clinical reasoning over linked EHR tables, clinical notes, chest radiographs, and guideline rules. Models must produce a staged artifact comprising a problem list, differential, workup, therapy, and monitoring, in which each claim cites typed evidence units and may abstain when information is insufficient. Provena-Med supports both full-information evaluation and an interactive evidence-seeking track. We further propose MM-AIS, which measures citation validity, objective support under evidence-removal tests, salient-evidence recall, and, for open-weight models, sensitivity to cited evidence. Across ten open-weight models and five cohorts, the best attribution yield is only 0.42, citation hallucination is common, and diagnostic accuracy, safety, and provenance do not reliably co-vary. Provena-Med provides an auditable testbed for evaluating grounded clinical reasoning beyond final-answer accuracy.