Causal Connections: Leveraging Multilingual Fine-Tuning for Financial QA@FinCausal 2026

Akash Kumar Gautam, Serhii Hamotskyi, Christian Hänig


Abstract
This paper describes team HSA_CORAL’s submission to the FinCausal 2026 shared task on extracting cause–effect relations from financial narratives via extractive question answering in English and Spanish. We compare three modeling families: (i) encoder-only token tagging with multilingual BERT, (ii) encoder–decoder generation with multilingual BART, and (iii) decoder-only LLMs (Llama 3.1 and GPT variants) using prompt refinement, few-shot demonstrations, and supervised fine-tuning. Across settings, prompting and few-shot examples yield competitive performance, but supervised fine-tuning is the main driver of improvement. Our best system, GPT-4.1 Mini fine-tuned on combined English and Spanish training data, achieves the highest (tied) score on English (score 4.8140) and ranks third on Spanish (score 4.7753) under the shared task’s LLM-as-a-judge metric. Overall, the results highlight the value of task-specific adaptation and multilingual fine-tuning for cross-lingual transfer in financial causality QA.
Anthology ID:
2026.fnp-1.13
Volume:
The 7th Financial Narrative Processing Workshop
Month:
May
Year:
2026
Address:
Palma de Mallorca, Spain
Editors:
Mo El-Haj, Antonio Moreno Sandoval, Ana Garcia-Serrano, Chung-Chi Chen, Paul Rayson, Yanco Amor Torterolo Orta, Paloma Martinez, Jordi Porta
Venues:
FNP | WS
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
132–138
Language:
External URL:
https://lrec.elra.info/lrec2026-ws-fnp-13
DOI:
10.63317/4v9j8247boo3
Bibkey:
Cite (ACL):
Akash Kumar Gautam, Serhii Hamotskyi, and Christian Hänig. 2026. Causal Connections: Leveraging Multilingual Fine-Tuning for Financial QA@FinCausal 2026. In The 7th Financial Narrative Processing Workshop, pages 132–138, Palma de Mallorca, Spain. European Language Resources Association (ELRA).
Cite (Informal):
Causal Connections: Leveraging Multilingual Fine-Tuning for Financial QA@FinCausal 2026 (Gautam et al., FNP 2026)
Copy Citation: