Adaptive Contrastive Learning on Multimodal Transformer for Review Helpfulness Prediction

Thong Nguyen, Xiaobao Wu, Anh Tuan Luu, Zhen Hai, Lidong Bing


Abstract
Modern Review Helpfulness Prediction systems are dependent upon multiple modalities, typically texts and images. Unfortunately, those contemporary approaches pay scarce attention to polish representations of cross-modal relations and tend to suffer from inferior optimization. This might cause harm to model’s predictions in numerous cases. To overcome the aforementioned issues, we propose Multi-modal Contrastive Learning for Multimodal Review Helpfulness Prediction (MRHP) problem, concentrating on mutual information between input modalities to explicitly elaborate cross-modal relations. In addition, we introduce Adaptive Weighting scheme for our contrastive learning approach in order to increase flexibility in optimization. Lastly, we propose Multimodal Interaction module to address the unalignment nature of multimodal data, thereby assisting the model in producing more reasonable multimodal representations. Experimental results show that our method outperforms prior baselines and achieves state-of-the-art results on two publicly available benchmark datasets for MRHP problem.
Anthology ID:
2022.emnlp-main.686
Volume:
Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing
Month:
December
Year:
2022
Address:
Abu Dhabi, United Arab Emirates
Editors:
Yoav Goldberg, Zornitsa Kozareva, Yue Zhang
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
10085–10096
Language:
URL:
https://aclanthology.org/2022.emnlp-main.686
DOI:
10.18653/v1/2022.emnlp-main.686
Bibkey:
Cite (ACL):
Thong Nguyen, Xiaobao Wu, Anh Tuan Luu, Zhen Hai, and Lidong Bing. 2022. Adaptive Contrastive Learning on Multimodal Transformer for Review Helpfulness Prediction. In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, pages 10085–10096, Abu Dhabi, United Arab Emirates. Association for Computational Linguistics.
Cite (Informal):
Adaptive Contrastive Learning on Multimodal Transformer for Review Helpfulness Prediction (Nguyen et al., EMNLP 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.emnlp-main.686.pdf