Jiajin Zhang
Author directory2026
BreastGPT: A Multimodal Large Language Model for the Full Spectrum of Breast Cancer Clinical Routine
Yang Liu | Jiajin Zhang | Danyang Tu | Yaojun Hu | Jiao Qu | Jiuyu Zhang | Yu Shi | Wei Fang | Shi Gu | Ling Zhang | Yingda Xia
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Yang Liu | Jiajin Zhang | Danyang Tu | Yaojun Hu | Jiao Qu | Jiuyu Zhang | Yu Shi | Wei Fang | Shi Gu | Ling Zhang | Yingda Xia
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Breast cancer care requires multimodal reasoning across a clinical workflow spanning screening, diagnosis, and treatment planning. However, existing medical MLLMs are typically limited to isolated modalities or narrow task settings, restricting their ability to support workflow-level clinical reasoning. To address this gap, we introduce BreastStage, a workflow-aligned breast imaging instruction corpus containing 1.86M instruction-following pairs from 17 sub-datasets, 5 imaging modalities, and 136 task templates, together with BreastStage-Bench, a benchmark for evaluating multimodal reasoning across the breast cancer care continuum. Built upon this corpus, we propose BreastGPT, a unified MLLM with a dual-branch visual encoder and concept-preserving token compression to bridge standard radiology and gigapixel pathology. On BreastStage-Bench, BreastGPT achieves 75.66% closed-ended accuracy and 89.92% open-ended score, outperforming both general-purpose and medical-specific MLLMs across clinical stages and task formats. Data, code, and model checkpoints are publicly released at https://anonymous.4open.science/w/BreastGPT_io/.
SeVeR: Selective Visual Exposure and Retrieval for 3D Medical Image Question Answering
Yaojun Hu | Danyang Tu | Yang Liu | Jiajin Zhang | Wei Fang | Zhiqiang Liu | Chunlai Dong | Yingda Xia | Haochao Ying | Jian Wu | Ling Zhang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Yaojun Hu | Danyang Tu | Yang Liu | Jiajin Zhang | Wei Fang | Zhiqiang Liu | Chunlai Dong | Yingda Xia | Haochao Ying | Jian Wu | Ling Zhang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Volumetric medical VQA requires reasoning over long and redundant 3D visual token sequences, especially in multi-sequence MRI where complementary modalities provide diverse diagnostic cues but expose the decoder to many repeated anatomical regions. To investigate reasoning under multi-sequence visual redundancy, we first introduce BreMRIs-VQA, a clinically curated breast MRI benchmark with 1.19M QA pairs from 71.0K sequences and 12.9K patients, covering both free-text and multiple-choice questions. We further propose SeVeR, a selective visual exposure framework that compresses dense volumes into modality-wise prototypes and retrieves complementary multi-level evidence with change-aware gated attention during decoding, trained with a marginal-utility self-consistency objective that suppresses unhelpful retrieval. Experiments on BreMRIs-VQA and public benchmarks show that SeVeR improves both discriminative and generative performance while exposing substantially fewer visual tokens.