LENS: Exploiting the Cross-View Stability Gap for Hallucination Mitigation in Medical Vision–Language Models

Dwarikanath Mahapatra, Abhijit Das, Sudipta Roy, Behzad Bozorgtabar, Imran Razzak


Abstract
Medical VLMs frequently hallucinate clinically unsupported findings. We identify a stability gap: visually grounded tokens maintain relatively stable logits under semantics-preserving image perturbations, whereas visually misgrounded tokens exhibit substantially larger shifts. We introduce LENS (Logit-ENhanced Stability), which exploits this signal at both training and inference. During training, Semantics-Preserving Preference Optimization (SPPO) scores preference pairs using clinical faithfulness and cross-view stability; at inference, stability-aware contrastive decoding penalizes tokens whose logits diverge across original and counterfactual views. Constrained counterfactuals use attribution-guided masking and feature-space proximity guards to reduce disruption of lesion- and device-level evidence. Across radiology VQA, chest X-ray reporting, and gastrointestinal endoscopy, LENS consistently outperforms strong decoding-time and preference-optimization baselines. On MIMIC-CXR, entity-level RadGraph recall improves from 21.0 to 22.8 over PCCD, while expert evaluation shows a hallucination-rate reduction from 17.0% to 8.5%.
Anthology ID:
2026.emnlp-main.88
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
2071–2081
Language:
URL:
https://aclanthology.org/2026.emnlp-main.88/
DOI:
Bibkey:
Cite (ACL):
Dwarikanath Mahapatra, Abhijit Das, Sudipta Roy, Behzad Bozorgtabar, and Imran Razzak. 2026. LENS: Exploiting the Cross-View Stability Gap for Hallucination Mitigation in Medical Vision–Language Models. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 2071–2081, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
LENS: Exploiting the Cross-View Stability Gap for Hallucination Mitigation in Medical Vision–Language Models (Mahapatra et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.88.pdf