Pengda Xiang

Author directory

2026

Patient education is a major NLP application, but current evaluation largely focuses on text-only assistance. In radiology, this overlooks an important part of clinical communication: patients often need both a plain-language explanation and a visual aid showing where to look and what it refers to. We introduce MediSketch, a multimodal patient-education task in which an agent must produce an image–text bundle: an educational image and a grounded plain-language explanation. We instantiate this setting with a clinician-curated radiology testbed, a structured multimodal rubric, and a rubric-following judge that evaluates bundle quality rather than text-only correctness. Under a matched image-generation budget, we compare three test-time scaling strategies: parallel sampling, sequential revision, and hybrid search. Across five backbone models, the no-scaling baseline remains weak, while naive parallel search often provides little gain despite using the full budget. Hybrid performs best on 4 of 5 backbones, suggesting that test-time compute works best when exploration and revision are combined. Further analysis identifies weak multimodal self-critique as a major bottleneck: many models stop revising too early and overestimate the quality of their own image–text outputs. MediSketch exposes both an evaluation gap in multimodal patient education and a concrete failure mode in test-time scaling.