Next-Year Bankruptcy Prediction from Textual Data: Benchmark and Baselines

Henri Arno, Klaas Mulier, Joke Baeck, Thomas Demeester


Abstract
Models for bankruptcy prediction are useful in several real-world scenarios, and multiple research contributions have been devoted to the task, based on structured (numerical) as well as unstructured (textual) data. However, the lack of a common benchmark dataset and evaluation strategy impedes the objective comparison between models. This paper introduces such a benchmark for the unstructured data scenario, based on novel and established datasets, in order to stimulate further research into the task. We describe and evaluate several classical and neural baseline models, and discuss benefits and flaws of different strategies. In particular, we find that a lightweight bag-of-words model based on static in-domain word representations obtains surprisingly good results, especially when taking textual data from several years into account. These results are critically assessed, and discussed in light of particular aspects of the data and the task. All code to replicate the data and experimental results will be released.
Anthology ID:
2022.finnlp-1.25
Volume:
Proceedings of the Fourth Workshop on Financial Technology and Natural Language Processing (FinNLP)
Month:
December
Year:
2022
Address:
Abu Dhabi, United Arab Emirates (Hybrid)
Editors:
Chung-Chi Chen, Hen-Hsen Huang, Hiroya Takamura, Hsin-Hsi Chen
Venue:
FinNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
187–195
Language:
URL:
https://aclanthology.org/2022.finnlp-1.25
DOI:
10.18653/v1/2022.finnlp-1.25
Bibkey:
Cite (ACL):
Henri Arno, Klaas Mulier, Joke Baeck, and Thomas Demeester. 2022. Next-Year Bankruptcy Prediction from Textual Data: Benchmark and Baselines. In Proceedings of the Fourth Workshop on Financial Technology and Natural Language Processing (FinNLP), pages 187–195, Abu Dhabi, United Arab Emirates (Hybrid). Association for Computational Linguistics.
Cite (Informal):
Next-Year Bankruptcy Prediction from Textual Data: Benchmark and Baselines (Arno et al., FinNLP 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.finnlp-1.25.pdf