Structured Radiology Intelligence: Extracting Structured Data from MRI Reports Using LLMs

Sushvin Marimuthu, Parameswari Krishnamurthy, Dipti Misra Sharma, Goldwin H, Anu Eapen, Betty Simon, Anuradha Chandramohan


Abstract
This study presents efforts focused on extracting and structuring doctor notes, specifically Magnetic Resonance Imaging (MRI) reports, into a standardized format using large language models (LLMs). We introduce a novel benchmark dataset comprising of 55 clinically relevant variables given by doctors, making it the first of its kind in the automated processing of unstructured medical texts. The annotations to the dataset were generated using a systematic prompt-tuning approach that was manually validated. It was then evaluated across three experimental stages: baseline, intermediate, and fine-tuned. Each stage assessed the impact of different prompt strategies on the performance of various LLMs (LLaMA, Qwen, and DeepSeek). Among the models tested, LLaMA 3.1 8B Instruct consistently achieved the highest composite Score in both the intermediate and final phases, resulting in an 18.42% improvement in performance.
Anthology ID:
2026.cl4health-1.24
Volume:
Proceedings of the Third Workshop on Patient-Oriented Language Processing (CL4Health) @ LREC 2026
Month:
May
Year:
2026
Address:
Palma, Mallorca (Spain)
Editors:
Deepak Gupta, Paul Thompson, Sophia Ananiadou, Dina Demner-Fushman
Venues:
CL4Health | WS
SIG:
Publisher:
ELRA Language Resources Association (ELRA)
Note:
Pages:
268–280
Language:
External URL:
https://lrec.elra.info/lrec2026-ws-cl4health-24
DOI:
10.63317/4vob5zztrfso
Bibkey:
Cite (ACL):
Sushvin Marimuthu, Parameswari Krishnamurthy, Dipti Misra Sharma, Goldwin H, Anu Eapen, Betty Simon, and Anuradha Chandramohan. 2026. Structured Radiology Intelligence: Extracting Structured Data from MRI Reports Using LLMs. In Proceedings of the Third Workshop on Patient-Oriented Language Processing (CL4Health) @ LREC 2026, pages 268–280, Palma, Mallorca (Spain). ELRA Language Resources Association (ELRA).
Cite (Informal):
Structured Radiology Intelligence: Extracting Structured Data from MRI Reports Using LLMs (Marimuthu et al., CL4Health 2026)
Copy Citation: