PAMN: Multi-phase Correlation Modeling for Contrast-Enhanced 3D Medical Image Retrieval

Haonan Tong, Ke Liu, Chuang Zhang, Xinglin Zhang, Tao Chen, Jenq-Neng Hwang, Lei Li


Abstract
Contrast-enhanced 3D Medical imaging (e.g., CT, MRI) leverages phase sequences to uncover temporal dynamics vital for diagnosing tumors, lesions, and vascular issues. However, current retrieval models primarily focus on spatial features, neglecting phase-specific progression detailed in clinical reports. We present the **Phase-aware Memory Network (PAMN)**, a novel framework enhancing 3D medical image retrieval by fusing imaging phases with diagnostic text. PAMN creates rich radiological representations that enhance diagnostic accuracy by combining image details with clinical report context, rigorously tested on a novel phase-series dataset of 12,230 hospital CT scans. PAMN achieves an effective balance of performance and scalability in 3D radiology retrieval, outperforming state-of-the-art baselines through the robust fusion of spatial, temporal, and textual information.
Anthology ID:
2025.findings-emnlp.184
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2025
Month:
November
Year:
2025
Address:
Suzhou, China
Editors:
Christos Christodoulopoulos, Tanmoy Chakraborty, Carolyn Rose, Violet Peng
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
3456–3467
Language:
URL:
https://aclanthology.org/2025.findings-emnlp.184/
DOI:
Bibkey:
Cite (ACL):
Haonan Tong, Ke Liu, Chuang Zhang, Xinglin Zhang, Tao Chen, Jenq-Neng Hwang, and Lei Li. 2025. PAMN: Multi-phase Correlation Modeling for Contrast-Enhanced 3D Medical Image Retrieval. In Findings of the Association for Computational Linguistics: EMNLP 2025, pages 3456–3467, Suzhou, China. Association for Computational Linguistics.
Cite (Informal):
PAMN: Multi-phase Correlation Modeling for Contrast-Enhanced 3D Medical Image Retrieval (Tong et al., Findings 2025)
Copy Citation:
PDF:
https://aclanthology.org/2025.findings-emnlp.184.pdf
Checklist:
 2025.findings-emnlp.184.checklist.pdf