Exploring the Impacts of Feature Fusion Strategy in Multi-modal Entity Alignment

Chenxiao Li, Jingwei Cheng, Qiang Tong, Fu Zhang


Abstract
Multi-modal entity alignment aims to identify equivalent entities between two different multi-modal knowledge graphs, which consist of structural triples and images associated with entities. Unfortunately, prior works fuse the multi-modal knowledge of all entities only via solely one single fusion strategy. Therefore, the impact of the fusion strategy on individual entities could be largely ignored. To solve this challenge, we propose AMF2SEA, an adaptive multi-modal feature fusion strategy for entity alignment, which dynamically selects the optimal entity-level feature fusion strategy. Additionally, we build a new dataset based on DBP15K, which includes a full set of entity images from multiple inconsistent web sources, making it more representative of the real world. Experimental results demonstrate that our model achieves state-of-the-art (SOTA) performance compared to models using the same modality on DBP15K and its variants with richer image sources and styles. Our code and data are available at https://github.com/ChenxiaoLiJoe/AMFFSEA.
Anthology ID:
2025.coling-main.522
Volume:
Proceedings of the 31st International Conference on Computational Linguistics
Month:
January
Year:
2025
Address:
Abu Dhabi, UAE
Editors:
Owen Rambow, Leo Wanner, Marianna Apidianaki, Hend Al-Khalifa, Barbara Di Eugenio, Steven Schockaert
Venue:
COLING
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
7809–7818
Language:
URL:
https://aclanthology.org/2025.coling-main.522/
DOI:
Bibkey:
Cite (ACL):
Chenxiao Li, Jingwei Cheng, Qiang Tong, and Fu Zhang. 2025. Exploring the Impacts of Feature Fusion Strategy in Multi-modal Entity Alignment. In Proceedings of the 31st International Conference on Computational Linguistics, pages 7809–7818, Abu Dhabi, UAE. Association for Computational Linguistics.
Cite (Informal):
Exploring the Impacts of Feature Fusion Strategy in Multi-modal Entity Alignment (Li et al., COLING 2025)
Copy Citation:
PDF:
https://aclanthology.org/2025.coling-main.522.pdf