GRAIL: Grounded Visual Alignment of Medical Vision-Language Models for Radiology Report Generation

Sarosij Bose, Ravi K. Rajendran, Biplob Debnath, Konstantinos Karydis, Amit Roy-Chowdhury, Srimat Chakradhar


Abstract
Radiology Report Generation (RRG) aims to reduce the burden of clinical documentation, yet generating reports that remain visually grounded in the input image remains challenging. Current medical vision-language models (Med-VLMs) often rely on curated preference data, retrieval augmentation, or large-scale labeled corpora, but remain prone to hallucinated findings due to weak cross-modal alignment. To address this challenge, we propose GRAIL: Grounded Radiology Alignment of Medical Vision-Language Models for Radiology Report Generation, a two-stage multimodal alignment framework for grounded RRG. First, Clinically Informed Textual Reasoning improves report structure and medical terminology using verifiable language rewards with periodic clinical guidance. Second, Expert-guided Visual Reasoning leverages a domain expert to rank generated reports using image-report alignment scores, encouraging visually grounded report generation without curated preference pairs or retrieval data. Experiments on multiple benchmarks show that GRAIL consistently improves both report generation quality and clinical accuracy, achieving relative gains over strong post-training baselines by up to 15% in clinical accuracy and 13% in generation quality. GRAIL also outperforms proprietary general-purpose and medical VLMs, highlighting the effectiveness of self-supervised multimodal post-alignment for reducing hallucinations in visually grounded radiology report generation.
Anthology ID:
2026.findings-emnlp.536
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
11262–11283
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.536/
DOI:
Bibkey:
Cite (ACL):
Sarosij Bose, Ravi K. Rajendran, Biplob Debnath, Konstantinos Karydis, Amit Roy-Chowdhury, and Srimat Chakradhar. 2026. GRAIL: Grounded Visual Alignment of Medical Vision-Language Models for Radiology Report Generation. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 11262–11283, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
GRAIL: Grounded Visual Alignment of Medical Vision-Language Models for Radiology Report Generation (Bose et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.536.pdf