Nickolas Elias Dawlabani

Author directory

2026

Many expert-domain decisions involve intermediate variables, yet standard LLM evaluation often measures only final-answer accuracy. We present a controlled study of intermediate-variable dependence in medical treatment selection, using diagnosis as an explicit variable between patient phenotype and treatment. We construct a six-option multiple-choice benchmark from PrimeKG-derived phenotype–disease–drug chains and evaluate six LLMs using behavioral diagnosis interventions, held-out QLoRA path supervision, external validation, and auxiliary layer-wise localization analysis. Providing the gold diagnosis improves average treatment accuracy from 49.9% to 84.9%, while incorrect predicted diagnoses reduce accuracy from 85.5% to 23.1%. A shuffled-diagnosis control yields 18.2% accuracy, suggesting that the effect depends on diagnosis correctness rather than merely adding disease-like text. Held-out QLoRA experiments show that path supervision improves treatment selection, with diagnosis-first full-chain and multitask objectives yielding the strongest gains. Center-of-Gravity localization further gives a modest diagnosis-first signal, which we interpret as a localization pattern rather than evidence of faithful clinical reasoning. Overall, in this controlled setting, final-answer accuracy can obscure failures in intermediate-variable dependence, while structured supervision can partially improve diagnosis-to-treatment behavior.