Financial Sentiment Analysis: An Investigation into Common Mistakes and Silver Bullets

Frank Xing, Lorenzo Malandri, Yue Zhang, Erik Cambria


Abstract
The recent dominance of machine learning-based natural language processing methods has fostered the culture of overemphasizing model accuracies rather than studying the reasons behind their errors. Interpretability, however, is a critical requirement for many downstream AI and NLP applications, e.g., in finance, healthcare, and autonomous driving. This study, instead of proposing any “new model”, investigates the error patterns of some widely acknowledged sentiment analysis methods in the finance domain. We discover that (1) those methods belonging to the same clusters are prone to similar error patterns, and (2) there are six types of linguistic features that are pervasive in the common errors. These findings provide important clues and practical considerations for improving sentiment analysis models for financial applications.
Anthology ID:
2020.coling-main.85
Volume:
Proceedings of the 28th International Conference on Computational Linguistics
Month:
December
Year:
2020
Address:
Barcelona, Spain (Online)
Editors:
Donia Scott, Nuria Bel, Chengqing Zong
Venue:
COLING
SIG:
Publisher:
International Committee on Computational Linguistics
Note:
Pages:
978–987
Language:
URL:
https://aclanthology.org/2020.coling-main.85
DOI:
10.18653/v1/2020.coling-main.85
Bibkey:
Cite (ACL):
Frank Xing, Lorenzo Malandri, Yue Zhang, and Erik Cambria. 2020. Financial Sentiment Analysis: An Investigation into Common Mistakes and Silver Bullets. In Proceedings of the 28th International Conference on Computational Linguistics, pages 978–987, Barcelona, Spain (Online). International Committee on Computational Linguistics.
Cite (Informal):
Financial Sentiment Analysis: An Investigation into Common Mistakes and Silver Bullets (Xing et al., COLING 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.coling-main.85.pdf