R3 -MDT: A Retain-Rerank-Revise Framework Based on Uncertainty and Consistency for Medical Decision Tree Extraction

Boyu Qiu, Xiaolong Weng, Zehua Wang, Buzhou Tang, Ying Xiong, Min Zhang


Abstract
Automatic extraction of Medical Decision Trees (MDTs) is an important task for Clinical Decision Support Systems, but remains challenging due to the complex logical structures involved. Recent approaches based on Large Language Models (LLMs) commonly adopt generate-then-revise pipelines with self-correction to improve reasoning accuracy. However, we find that applying revision uniformly across all samples can be harmful, as it often alters already correct and stable predictions, leading to over-correction on simple cases. To alleviate this issue, we propose R3-MDT, an adaptive inference framework that dynamically selects reasoning strategies based on sample difficulty. We use model uncertainty and output consistency as internal signals to estimate difficulty and route samples into Easy, Medium, and Hard categories. For Easy samples with confident and consistent predictions, we directly retain the initial outputs. Medium-difficulty samples, which exhibit ambiguity among multiple plausible candidates, are handled via reranking to select the optimal decision tree. Hard samples, characterized by high uncertainty and structural inconsistency, are revised to rectify intractable generation failures. By adaptively selecting inference strategies based on difficulty levels, R3-MDT avoids unnecessary revisions while effectively correcting underlying reasoning failures. Experiments on the Text2DT benchmark show that R3-MDT alleviates the over-correction problem and achieves state-of-the-art performance, while auxiliary language- and task-shift evaluations indicate the broader transferability of its routing principle.
Anthology ID:
2026.findings-emnlp.1757
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
37577–37594
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.1757/
DOI:
Bibkey:
Cite (ACL):
Boyu Qiu, Xiaolong Weng, Zehua Wang, Buzhou Tang, Ying Xiong, and Min Zhang. 2026. R3 -MDT: A Retain-Rerank-Revise Framework Based on Uncertainty and Consistency for Medical Decision Tree Extraction. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 37577–37594, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
R3 -MDT: A Retain-Rerank-Revise Framework Based on Uncertainty and Consistency for Medical Decision Tree Extraction (Qiu et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.1757.pdf