Predict the Future from the Past? On the Temporal Data Distribution Shift in Financial Sentiment Classifications

Yue Guo, Chenxi Hu, Yi Yang


Abstract
Temporal data distribution shift is prevalent in the financial text. How can a financial sentiment analysis system be trained in a volatile market environment that can accurately infer sentiment and be robust to temporal data distribution shifts? In this paper, we conduct an empirical study on the financial sentiment analysis system under temporal data distribution shifts using a real-world financial social media dataset that spans three years. We find that the fine-tuned models suffer from general performance degradation in the presence of temporal distribution shifts. Furthermore, motivated by the unique temporal nature of the financial text, we propose a novel method that combines out-of-distribution detection with time series modeling for temporal financial sentiment analysis. Experimental results show that the proposed method enhances the model’s capability to adapt to evolving temporal shifts in a volatile financial market.
Anthology ID:
2023.emnlp-main.65
Volume:
Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing
Month:
December
Year:
2023
Address:
Singapore
Editors:
Houda Bouamor, Juan Pino, Kalika Bali
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1029–1038
Language:
URL:
https://aclanthology.org/2023.emnlp-main.65
DOI:
10.18653/v1/2023.emnlp-main.65
Bibkey:
Cite (ACL):
Yue Guo, Chenxi Hu, and Yi Yang. 2023. Predict the Future from the Past? On the Temporal Data Distribution Shift in Financial Sentiment Classifications. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 1029–1038, Singapore. Association for Computational Linguistics.
Cite (Informal):
Predict the Future from the Past? On the Temporal Data Distribution Shift in Financial Sentiment Classifications (Guo et al., EMNLP 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.emnlp-main.65.pdf
Video:
 https://aclanthology.org/2023.emnlp-main.65.mp4