Qianqian Shi

Author directory

2026

Brain tumor MRI diagnosis requires models not only to identify lesions but also to perform fine-grained medical reasoning based on imaging modality, tumor location, and key imaging findings. However, existing medical multimodal datasets often lack structured diagnostic semantics, and closed-ended evaluations may overestimate model ability due to option cues or elimination shortcuts. To address this issue, we introduce MM-NeuroOnco, a large-scale multimodal instruction dataset and benchmark for brain tumor MRI diagnostic reasoning, containing 24,726 MRI slices from 20 public data sources and approximately 200,000 multimodal instructions grounded in imaging evidence. We develop a multi-model collaborative pipeline for semantic completion and quality control, which supplements original tumor labels and segmentation masks with key diagnostic attributes, and further construct MM-NeuroOnco-Bench with a no-LLM-inference policy for ground-truth labels. The benchmark adds a “None of the above” option to closed-ended questions to reduce evaluation bias caused by option shortcuts. Experiments show that existing general-purpose and medical-specialist multimodal large models remain limited on this task, with the strongest baseline achieving only 41.88% accuracy on diagnosis-related questions. Fine-tuning on MM-NeuroOnco yields NeuroOnco-GPT, achieving a 27% absolute accuracy improvement and demonstrating the effectiveness of our dataset in enhancing fine-grained multimodal medical reasoning. Code and dataset documentation are available at https://github.com/gfnnnb/MM-NeuroOnco.