Decisions by Discrimination: Differential Evidence for Medical Reasoning

Yunpeng Xiao, Yuzhang Xie, Junhao Huang, Carl Yang, Xiao Hu, Kai Shu


Abstract
Large language models (LLMs) are increasingly studied for clinical decision support, and medical question answering provides an effective testbed for evaluating this capability. In particular, medical multiple-choice questions (MCQs) reflect a core challenge in clinical decision-making: plausible options often share substantial overlapping evidence, while only a few decisive factors distinguish the correct option from other incorrect ones. However, existing retrieval-based and reasoning-oriented methods mainly focus on supplying broadly relevant knowledge or eliciting reasoning paths, rather than identifying the compact differential evidence that separates confusing alternatives. In this work, we present a retrieval-grounded differential evidence framework for medical MCQs. Our method extracts option-specific pieces of differential evidence and organizes them into concise evidence prompts for answer selection. This design better aligns external knowledge with differential reasoning while reducing irrelevant context. Experiments show consistent accuracy gains over strong baselines. Ablation studies further show that our framework outperforms both directly using retrieved evidence chunks and closed-source LLM-generated general hints, and that its improvements are not solely explained by answer-proximal guidance, but are consistent with differential evidence serving as a compact aid for reasoning over competing alternatives. Our findings also offer insights for medical reasoning and other decision-making settings with multiple possible choices.
Anthology ID:
2026.aacl-long.250
Volume:
Proceedings of the 15th International Joint Conference on Natural Language Processing and the 5th Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
November
Year:
2026
Address:
Hengqin, China
Editors:
Yue Zhang, Ruifeng Xu, Ayu Purwarianti, Tong Rong, Jun Suzuki
Venues:
AACL | IJCNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
5589–5603
Language:
URL:
https://aclanthology.org/2026.aacl-long.250/
DOI:
Bibkey:
Cite (ACL):
Yunpeng Xiao, Yuzhang Xie, Junhao Huang, Carl Yang, Xiao Hu, and Kai Shu. 2026. Decisions by Discrimination: Differential Evidence for Medical Reasoning. In Proceedings of the 15th International Joint Conference on Natural Language Processing and the 5th Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (Volume 1: Long Papers), pages 5589–5603, Hengqin, China. Association for Computational Linguistics.
Cite (Informal):
Decisions by Discrimination: Differential Evidence for Medical Reasoning (Xiao et al., AACL-IJCNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.aacl-long.250.pdf