LUMINA: LongitUdinal MultImodal reasoNing Agent for Medical Imaging

Zhaoqi An, Yunchang Xie, Xiaobing Yu, Yuyi Yang, Ahmad Chowdhury, Peijie Qiu


Abstract
Multimodal large language models (MLLMs) have shown strong performance in perception and question-answering, but many clinical decisions require reasoning across observations collected over time rather than from a single input. We study this problem in longitudinal modeling, where evidence evolves across visits. We introduce LUMINA (LongitUdinal MultImodal reasoNing Agent), a single-agent framework that incrementally builds an auditable evidence state before making predictions. Instead of predicting directly from all observations, LUMINA organizes current evidence, compares observations across prior visits, maintains longitudinal memory, optionally retrieves relevant cross-subject summaries, and verifies whether the accumulated evidence supports the final decision. We evaluate LUMINA on two subject-level benchmarks: Alzheimer’s disease classification and 36-month progression forecasting from observed visit prefixes. Across nine MLLM backbones, LUMINA consistently outperforms MLLM baselines and an adapted medical reasoning agent, achieving 13.8%–18.5% relative balanced accuracy gains on classification and 16.8%–24.8% gains on progression forecasting over the strongest non-agent baseline. Additional evaluations preserve the same method ordering on Parkinsonian-state classification and breast cancer treatment-response prediction.
Anthology ID:
2026.emnlp-main.1753
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
39983–40006
Language:
URL:
https://aclanthology.org/2026.emnlp-main.1753/
DOI:
Bibkey:
Cite (ACL):
Zhaoqi An, Yunchang Xie, Xiaobing Yu, Yuyi Yang, Ahmad Chowdhury, and Peijie Qiu. 2026. LUMINA: LongitUdinal MultImodal reasoNing Agent for Medical Imaging. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 39983–40006, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
LUMINA: LongitUdinal MultImodal reasoNing Agent for Medical Imaging (An et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.1753.pdf