Reinforcing Traceable Medical Reasoning with Critical Evidence Graph

Linjie Mu, Yannian Gu, Zhongzhen Huang, Yakun Zhu, Shaoting Zhang, Xiaofan Zhang


Abstract
Large language models (LLMs) with reasoning capabilities have shown impressive performance in clinical applications, yet the readability and traceability of their reasoning processes remain limited, as reasoning quality is often overlooked during training. To address this, we propose MedCEG, a framework that augments medical language models with clinically traceable reasoning by explicitly supervising the reasoning process through a critical evidence graph (CEG). Specifically, we curate challenging clinical cases and algorithmically construct a CEG for each sample via multi-model consensus as a high-quality, traceable reasoning pathway. The CEG reformulates the reasoning process for supervised fine-tuning and underpins a traceable reasoning procedure reward that evaluates generated reasoning against the CEG through deterministic graph operations measuring semantic matching, triplet recall and connected-component analysis. Experiments show that MedCEG surpasses existing methods among open-source medical models of comparable scale while producing clinically readable and traceable reasoning chains. Code and models are available at https://github.com/LinjieMu/MedCEG.
Anthology ID:
2026.findings-emnlp.1088
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
23019–23042
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.1088/
DOI:
Bibkey:
Cite (ACL):
Linjie Mu, Yannian Gu, Zhongzhen Huang, Yakun Zhu, Shaoting Zhang, and Xiaofan Zhang. 2026. Reinforcing Traceable Medical Reasoning with Critical Evidence Graph. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 23019–23042, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Reinforcing Traceable Medical Reasoning with Critical Evidence Graph (Mu et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.1088.pdf