Speech-Emotion Detection in an Indonesian Movie

Fahmi Fahmi, Meganingrum Arista Jiwanggi, Mirna Adriani


Abstract
The growing demand to develop an automatic emotion recognition system for the Human-Computer Interaction field had pushed some research in speech emotion detection. Although it is growing, there is still little research about automatic speech emotion detection in Bahasa Indonesia. Another issue is the lack of standard corpus for this research area in Bahasa Indonesia. This study proposed several approaches to detect speech-emotion in the dialogs of an Indonesian movie by classifying them into 4 different emotion classes i.e. happiness, sadness, anger, and neutral. There are two different speech data representations used in this study i.e. statistical and temporal/sequence representations. This study used Artificial Neural Network (ANN), Recurrent Neural Network (RNN) with Long Short Term Memory (LSTM) variation, word embedding, and also the hybrid of three to perform the classification task. The best accuracies given by one-vs-rest scenario for each emotion class with speech-transcript pairs using hybrid of non-temporal and embedding approach are 1) happiness: 76.31%; 2) sadness: 86.46%; 3) anger: 82.14%; and 4) neutral: 68.51%. The multiclass classification resulted in 64.66% of precision, 66.79% of recall, and 64.83% of F1-score.
Anthology ID:
2020.sltu-1.26
Volume:
Proceedings of the 1st Joint Workshop on Spoken Language Technologies for Under-resourced languages (SLTU) and Collaboration and Computing for Under-Resourced Languages (CCURL)
Month:
May
Year:
2020
Address:
Marseille, France
Venues:
LREC | SLTU | WS
SIG:
Publisher:
European Language Resources association
Note:
Pages:
185–193
Language:
English
URL:
https://aclanthology.org/2020.sltu-1.26
DOI:
Bibkey:
Cite (ACL):
Fahmi Fahmi, Meganingrum Arista Jiwanggi, and Mirna Adriani. 2020. Speech-Emotion Detection in an Indonesian Movie. In Proceedings of the 1st Joint Workshop on Spoken Language Technologies for Under-resourced languages (SLTU) and Collaboration and Computing for Under-Resourced Languages (CCURL), pages 185–193, Marseille, France. European Language Resources association.
Cite (Informal):
Speech-Emotion Detection in an Indonesian Movie (Fahmi et al., SLTU 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.sltu-1.26.pdf