Ghazia Pervaiz
Author directory2026
Diagnosis Before Treatment? Investigating Intermediate-Variable Reasoning in LLMs
Zhishan Yuan | Tiago Almeida | Shudong Hao | Zining Zhu | Nickolas Elias Dawlabani | Ghazia Pervaiz | Yue Ning
Findings of the Association for Computational Linguistics: EMNLP 2026
Zhishan Yuan | Tiago Almeida | Shudong Hao | Zining Zhu | Nickolas Elias Dawlabani | Ghazia Pervaiz | Yue Ning
Findings of the Association for Computational Linguistics: EMNLP 2026
Many expert-domain decisions involve intermediate variables, yet standard LLM evaluation often measures only final-answer accuracy. We present a controlled study of intermediate-variable dependence in medical treatment selection, using diagnosis as an explicit variable between patient phenotype and treatment. We construct a six-option multiple-choice benchmark from PrimeKG-derived phenotype–disease–drug chains and evaluate six LLMs using behavioral diagnosis interventions, held-out QLoRA path supervision, external validation, and auxiliary layer-wise localization analysis. Providing the gold diagnosis improves average treatment accuracy from 49.9% to 84.9%, while incorrect predicted diagnoses reduce accuracy from 85.5% to 23.1%. A shuffled-diagnosis control yields 18.2% accuracy, suggesting that the effect depends on diagnosis correctness rather than merely adding disease-like text. Held-out QLoRA experiments show that path supervision improves treatment selection, with diagnosis-first full-chain and multitask objectives yielding the strongest gains. Center-of-Gravity localization further gives a modest diagnosis-first signal, which we interpret as a localization pattern rather than evidence of faithful clinical reasoning. Overall, in this controlled setting, final-answer accuracy can obscure failures in intermediate-variable dependence, while structured supervision can partially improve diagnosis-to-treatment behavior.