Estimating the Uncertainty in Emotion Attributes using Deep Evidential Regression

Wen Wu, Chao Zhang, Philip Woodland


Abstract
In automatic emotion recognition (AER), labels assigned by different human annotators to the same utterance are often inconsistent due to the inherent complexity of emotion and the subjectivity of perception. Though deterministic labels generated by averaging or voting are often used as the ground truth, it ignores the intrinsic uncertainty revealed by the inconsistent labels. This paper proposes a Bayesian approach, deep evidential emotion regression (DEER), to estimate the uncertainty in emotion attributes. Treating the emotion attribute labels of an utterance as samples drawn from an unknown Gaussian distribution, DEER places an utterance-specific normal-inverse gamma prior over the Gaussian likelihood and predicts its hyper-parameters using a deep neural network model. It enables a joint estimation of emotion attributes along with the aleatoric and epistemic uncertainties. AER experiments on the widely used MSP-Podcast and IEMOCAP datasets showed DEER produced state-of-the-art results for both the mean values and the distribution of emotion attributes.
Anthology ID:
2023.acl-long.873
Volume:
Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Anna Rogers, Jordan Boyd-Graber, Naoaki Okazaki
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
15681–15695
Language:
URL:
https://aclanthology.org/2023.acl-long.873
DOI:
10.18653/v1/2023.acl-long.873
Bibkey:
Cite (ACL):
Wen Wu, Chao Zhang, and Philip Woodland. 2023. Estimating the Uncertainty in Emotion Attributes using Deep Evidential Regression. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 15681–15695, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
Estimating the Uncertainty in Emotion Attributes using Deep Evidential Regression (Wu et al., ACL 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.acl-long.873.pdf
Video:
 https://aclanthology.org/2023.acl-long.873.mp4