You Only Query Twice: Multimodal Rumor Detection via Evidential Evaluation from Dual Perspectives

Junyi Chen, Leyuan Liu, Tian Lan, Fan Zhou, Xiaosong Zhang


Abstract
Current rumor detectors exhibit limitations in fully exploiting responses to the source tweet as essential public opinions, and in explaining and indicating the reliability of the results obtained. Additionally, the joint utilization of both responses and the multimodal source content for detection presents challenges due to the heterogeneous nature of the data points. In this work, to address the first challenge, we initially prompt the Large Language Model (LLM) with both multimodal source content and the corresponding response set to extract contrasting evidence to enable maximal utilization of informative responses. To overcome the second challenge, we introduce an uncertainty-aware evidential evaluator to assess the evidence intensity from the multimodal source content and dual-sided reasoning, from which the final prediction is derived. As we model the second-order probability, we can effectively indicate the model’s uncertainty (i.e., the reliability) of the results. The reasoning from the correct perspective also serves as a natural language-based explanation. To this end, the third challenge is also addressed as we fully leverage the available resources. Extensive experiments validate the effectiveness, uncertainty awareness in predictions, helpful explainability for human judgment, and superior efficiency of our approach compared to contemporary works utilizing LLMs.
Anthology ID:
2025.coling-main.230
Volume:
Proceedings of the 31st International Conference on Computational Linguistics
Month:
January
Year:
2025
Address:
Abu Dhabi, UAE
Editors:
Owen Rambow, Leo Wanner, Marianna Apidianaki, Hend Al-Khalifa, Barbara Di Eugenio, Steven Schockaert
Venue:
COLING
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
3415–3427
Language:
URL:
https://aclanthology.org/2025.coling-main.230/
DOI:
Bibkey:
Cite (ACL):
Junyi Chen, Leyuan Liu, Tian Lan, Fan Zhou, and Xiaosong Zhang. 2025. You Only Query Twice: Multimodal Rumor Detection via Evidential Evaluation from Dual Perspectives. In Proceedings of the 31st International Conference on Computational Linguistics, pages 3415–3427, Abu Dhabi, UAE. Association for Computational Linguistics.
Cite (Informal):
You Only Query Twice: Multimodal Rumor Detection via Evidential Evaluation from Dual Perspectives (Chen et al., COLING 2025)
Copy Citation:
PDF:
https://aclanthology.org/2025.coling-main.230.pdf