Marco Saioni
2024
Multimodal Attention Is All You Need
Marco Saioni
|
Cristina Giannone
Proceedings of the 10th Italian Conference on Computational Linguistics (CLiC-it 2024)
In this paper, we present a multimodal model for classifying fake news. The main peculiarity of the proposed model is the cross attention mechanism. Cross-attention is an evolution of the attention mechanism that allows the model to examine intermodal relationships to better understand information from different modalities, enabling it to simultaneously focus on the relevant parts of the data extracted from each. We tested the model using MULTI-Fake-DetectiVE data from Evalita 2023. The presented model is particularly effective in both the tasks of classifying fake news and evaluating the intermodal relationship.