Cross-Modal Inconsistency in Multimodal LLMs during Crisis Communication

Anuridhi Gupta, Hemant Purohit


Abstract
In this paper, we evaluate three state-of-the-art (SOTA) MM-LLMs on consistency of their outputs across text and audio modalities using real emergency alerts. Building on prior semantic-similarity and factual-overlap evaluation, we introduce a LIWC aligned analysis of modality dependent differences in linguistic structure, interpersonal framing, urgency, risk, and action-oriented language. Our findings indicate that despite being unified models, capable of taking in input from different modalities, no single model was able to achieve reliable cross-modal consistency. Persona-level results further indicate that cross-modal disparities vary across user groups. This introduces modality dependent inequity that unfairly affects individuals with access and functional needs. We release prompts, audio recordings, model outputs and evaluation material to support the crisis language technology community in building equitable solution for crisis management.
Anthology ID:
2026.lt4cpr-1.9
Volume:
Proceedings of the First Workshop on Language Technologies for Crisis Preparedness and Response
Month:
November
Year:
2026
Address:
Hengqin, China
Editors:
Belu Ticona, Fei Xia, William D. Lewis, Antonios Anastasopoulos
Venues:
LT4CPR | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
115–125
Language:
URL:
https://aclanthology.org/2026.lt4cpr-1.9/
DOI:
Bibkey:
Cite (ACL):
Anuridhi Gupta and Hemant Purohit. 2026. Cross-Modal Inconsistency in Multimodal LLMs during Crisis Communication. In Proceedings of the First Workshop on Language Technologies for Crisis Preparedness and Response, pages 115–125, Hengqin, China. Association for Computational Linguistics.
Cite (Informal):
Cross-Modal Inconsistency in Multimodal LLMs during Crisis Communication (Gupta & Purohit, LT4CPR 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.lt4cpr-1.9.pdf