MLDSP-MA: Multidimensional Attention for Multi-Round Long Dialogue Sentiment Prediction

Yunfei Yin, Congrui Zou, Zheng Yuan, Xianjian Bao


Abstract
The intelligent chatbot takes dialogue sentiment prediction as the core, and it has to tackle long dialogue sentiment prediction problems in many real-world applications. Current state-of-the-art methods usually employ attention-based dialogue sentiment prediction models. However, as the conversation progresses, more topics are involved and the changes in sentiments become more frequent, which leads to a sharp decline in the accuracy and efficiency of the current methods. Therefore, we propose a Multi-round Long Dialogue Sentiment Prediction based on Multidimensional Attention (MLDSP-MA), which can focus on different topics. In particular, MLSDP-MA leverages a sliding window to capture different topics and traverses all historical dialogues. In each sliding window, the contextual dependency, sentiment persistence, and sentiment infectivity are characterized, and local attention cross fusion is performed. To learn dialogue sentiment globally, global attention is proposed to iteratively learn comprehensive sentiments from historical dialogues, and finally integrate with local attention. We conducted extensive experimental research on publicly available dialogue datasets. The experimental results show that, compared to the current state-of-the-art methods, our model improves by 3.5% in accuracy and 5.7% in Micro-F1 score.
Anthology ID:
2024.lrec-main.997
Volume:
Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)
Month:
May
Year:
2024
Address:
Torino, Italia
Editors:
Nicoletta Calzolari, Min-Yen Kan, Veronique Hoste, Alessandro Lenci, Sakriani Sakti, Nianwen Xue
Venues:
LREC | COLING
SIG:
Publisher:
ELRA and ICCL
Note:
Pages:
11405–11414
Language:
URL:
https://aclanthology.org/2024.lrec-main.997
DOI:
Bibkey:
Cite (ACL):
Yunfei Yin, Congrui Zou, Zheng Yuan, and Xianjian Bao. 2024. MLDSP-MA: Multidimensional Attention for Multi-Round Long Dialogue Sentiment Prediction. In Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), pages 11405–11414, Torino, Italia. ELRA and ICCL.
Cite (Informal):
MLDSP-MA: Multidimensional Attention for Multi-Round Long Dialogue Sentiment Prediction (Yin et al., LREC-COLING 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.lrec-main.997.pdf