Federated Meta-Learning for Emotion and Sentiment Aware Multi-modal Complaint Identification

Apoorva Singh, Siddarth Chandrasekar, Sriparna Saha, Tanmay Sen


Abstract
Automatic detection of consumers’ complaints about items or services they buy can be critical for organizations and online merchants. Previous studies on complaint identification are limited to text. Images along with the reviews can provide cues to identify complaints better, thus emphasizing the importance of incorporating multi-modal inputs into the process. Generally, the customer’s emotional state significantly impacts the complaint expression; thus, the effect of emotion and sentiment on complaint identification must also be investigated. Furthermore, different organizations are usually not allowed to share their privacy-sensitive records due to data security and privacy concerns. Due to these issues, traditional models find it hard to understand and identify complaint patterns, particularly in the financial and healthcare sectors. In this work, we created a new dataset - Multi-modal Complaint Dataset (MCD), a collection of reviews and images of the products posted on the website of the retail giant Amazon. We propose a federated meta-learning-based multi-modal multi-task framework for identifying complaints considering emotion recognition and sentiment analysis as two auxiliary tasks. Experimental results indicate that the proposed approach outperforms the baselines and the state-of-the-art approaches in centralized and federated meta-learning settings.
Anthology ID:
2023.emnlp-main.999
Volume:
Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing
Month:
December
Year:
2023
Address:
Singapore
Editors:
Houda Bouamor, Juan Pino, Kalika Bali
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
16091–16103
Language:
URL:
https://aclanthology.org/2023.emnlp-main.999
DOI:
10.18653/v1/2023.emnlp-main.999
Bibkey:
Cite (ACL):
Apoorva Singh, Siddarth Chandrasekar, Sriparna Saha, and Tanmay Sen. 2023. Federated Meta-Learning for Emotion and Sentiment Aware Multi-modal Complaint Identification. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 16091–16103, Singapore. Association for Computational Linguistics.
Cite (Informal):
Federated Meta-Learning for Emotion and Sentiment Aware Multi-modal Complaint Identification (Singh et al., EMNLP 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.emnlp-main.999.pdf
Video:
 https://aclanthology.org/2023.emnlp-main.999.mp4