Word-Level Uncertainty Estimation for Black-Box Text Classifiers using RNNs

Jakob Smedegaard Andersen, Tom Schöner, Walid Maalej


Abstract
Estimating uncertainties of Neural Network predictions paves the way towards more reliable and trustful text classifications. However, common uncertainty estimation approaches remain as black-boxes without explaining which features have led to the uncertainty of a prediction. This hinders users from understanding the cause of unreliable model behaviour. We introduce an approach to decompose and visualize the uncertainty of text classifiers at the level of words. Our approach builds on top of Recurrent Neural Networks and Bayesian modelling in order to provide detailed explanations of uncertainties, enabling a deeper reasoning about unreliable model behaviours. We conduct a preliminary experiment to check the impact and correctness of our approach. By explaining and investigating the predictive uncertainties of a sentiment analysis task, we argue that our approach is able to provide a more profound understanding of artificial decision making.
Anthology ID:
2020.coling-main.484
Volume:
Proceedings of the 28th International Conference on Computational Linguistics
Month:
December
Year:
2020
Address:
Barcelona, Spain (Online)
Editors:
Donia Scott, Nuria Bel, Chengqing Zong
Venue:
COLING
SIG:
Publisher:
International Committee on Computational Linguistics
Note:
Pages:
5541–5546
Language:
URL:
https://aclanthology.org/2020.coling-main.484
DOI:
10.18653/v1/2020.coling-main.484
Bibkey:
Cite (ACL):
Jakob Smedegaard Andersen, Tom Schöner, and Walid Maalej. 2020. Word-Level Uncertainty Estimation for Black-Box Text Classifiers using RNNs. In Proceedings of the 28th International Conference on Computational Linguistics, pages 5541–5546, Barcelona, Spain (Online). International Committee on Computational Linguistics.
Cite (Informal):
Word-Level Uncertainty Estimation for Black-Box Text Classifiers using RNNs (Andersen et al., COLING 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.coling-main.484.pdf
Code
 jsandersen/wu-rnn