MCASP: Multi-Modal Cross Attention Network for Stock Market Prediction

Kamaladdin Fataliyev, Wei Liu


Abstract
Stock market prediction is considered a complex task due to the non-stationary and volatile nature of the stock markets. With the increasing amount of online data, various information sources have been analyzed to understand the underlying patterns of the price movements. However, most existing works in the literature mostly focus on either the intra-modality information within each input data type, or the inter-modal relationships among the input modalities. Different from these, in this research, we propose a novel Multi-Modal Cross Attention Network for Stock Market Prediction (MCASP) by capturing both modality-specific features and the joint influence of each modality in a unified framework. We utilize financial news, historical market data and technical indicators to predict the movement direction of the market prices. After processing the input modalities with three separate deep networks, we first construct a self-attention network that utilizes multiple Transformer models to capture the intra-modal information. Then we design a novel cross-attention network that processes the inputs in pairs to exploit the cross-modal and joint information of the modalities. Experiments with real world datasets for S&P500 index forecast and the prediction of five individual stocks, demonstrate the effectiveness of the proposed multi-modal design over several state-of-the-art baseline models.
Anthology ID:
2023.alta-1.7
Volume:
Proceedings of the 21st Annual Workshop of the Australasian Language Technology Association
Month:
November
Year:
2023
Address:
Melbourne, Australia
Editors:
Smaranda Muresan, Vivian Chen, Kennington Casey, Vandyke David, Dethlefs Nina, Inoue Koji, Ekstedt Erik, Ultes Stefan
Venue:
ALTA
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
67–77
Language:
URL:
https://aclanthology.org/2023.alta-1.7
DOI:
Bibkey:
Cite (ACL):
Kamaladdin Fataliyev and Wei Liu. 2023. MCASP: Multi-Modal Cross Attention Network for Stock Market Prediction. In Proceedings of the 21st Annual Workshop of the Australasian Language Technology Association, pages 67–77, Melbourne, Australia. Association for Computational Linguistics.
Cite (Informal):
MCASP: Multi-Modal Cross Attention Network for Stock Market Prediction (Fataliyev & Liu, ALTA 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.alta-1.7.pdf