Miao Liu
Author directoryOther people with similar names: Miao Liu, Miao Liu
Unverified author pages with similar names: Miao Liu
2026
Learning Pathology-Localized Medical Vision–Language Representations with Atomic and Grounded Disease Supervision
Mong Yuan Sim | Wei Emma Zhang | Xiang Dai | Byron Fang | Miao Liu
Findings of the Association for Computational Linguistics: EMNLP 2026
Mong Yuan Sim | Wei Emma Zhang | Xiang Dai | Byron Fang | Miao Liu
Findings of the Association for Computational Linguistics: EMNLP 2026
Medical vision-language models are typically trained by aligning whole images with entire radiology reports, assuming that global correspondence is sufficient for learning clinically meaningful representations. We argue that effective medical representation learning requires pathology-localized supervision, which explicitly aligns specific disease observations with their corresponding anatomical image regions. To enable this at scale, we propose a fully automated pipeline that decomposes radiology reports into atomic disease observations, identifies relevant regions, and pairs them with corresponding image regions without manual annotation, resulting in a fine-grained dataset, LocalizedCXR, with over 6 million region–caption pairs. Through extensive experiments, we demonstrate that our pathology-localized semantic supervision significantly improve performance in cross-modal retrieval, image classification, and phrase grounding of radiology findings. Our results suggest that moving beyond global alignment to disease-aware region-level alignment is essential for developing effective medical vision-language representation learning.