Ricky Ho Yin Chan
2016
Real-Time Speech Emotion and Sentiment Recognition for Interactive Dialogue Systems
Dario Bertero
|
Farhad Bin Siddique
|
Chien-Sheng Wu
|
Yan Wan
|
Ricky Ho Yin Chan
|
Pascale Fung
Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing
Zara: A Virtual Interactive Dialogue System Incorporating Emotion, Sentiment and Personality Recognition
Pascale Fung
|
Anik Dey
|
Farhad Bin Siddique
|
Ruixi Lin
|
Yang Yang
|
Dario Bertero
|
Yan Wan
|
Ricky Ho Yin Chan
|
Chien-Sheng Wu
Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: System Demonstrations
Zara, or ‘Zara the Supergirl’ is a virtual robot, that can exhibit empathy while interacting with an user, with the aid of its built in facial and emotion recognition, sentiment analysis, and speech module. At the end of the 5-10 minute conversation, Zara can give a personality analysis of the user based on all the user utterances. We have also implemented a real-time emotion recognition, using a CNN model that detects emotion from raw audio without feature extraction, and have achieved an average of 65.7% accuracy on six different emotion classes, which is an impressive 4.5% improvement from the conventional feature based SVM classification. Also, we have described a CNN based sentiment analysis module trained using out-of-domain data, that recognizes sentiment from the speech recognition transcript, which has a 74.8 F-measure when tested on human-machine dialogues.
Search
Co-authors
- Dario Bertero 2
- Farhad Bin Siddique 2
- Chien-Sheng Wu 2
- Yan Wan 2
- Pascale Fung 2
- show all...