Sarang at FinCausal 2025: Contextual QA for Financial Causality Detection Combining Extractive and Generative Models

Avinash Trivedi, Gauri Toshniwal, Sangeetha S, S R. Balasundaram


Abstract
This paper describes our approach for the FinCausal 2025 English Shared Task, aimed at detecting and extracting causal relationships from the financial text. The task involved answering context-driven questions to identify causes or effects within specified text segments. Our method utilized a consciousAI RoBERTa-base encoder model, fine-tuned on the SQuADx dataset. We further fine-tuned it using the FinCausal 2025 development set. To enhance the quality and contextual relevance of the answers, we passed outputs from the extractive model through Gemma2-9B, a generative large language model, for answer refinement. This hybrid approach effectively addressed the task’s requirements, showcasing the strength of combining extractive and generative models. We (Team name: Sarang) achieved outstanding results, securing 3rd rank with a Semantic Answer Similarity (SAS) score of 96.74% and an Exact Match (EM) score of 70.14%.
Anthology ID:
2025.finnlp-1.25
Volume:
Proceedings of the Joint Workshop of the 9th Financial Technology and Natural Language Processing (FinNLP), the 6th Financial Narrative Processing (FNP), and the 1st Workshop on Large Language Models for Finance and Legal (LLMFinLegal)
Month:
January
Year:
2025
Address:
Abu Dhabi, UAE
Editors:
Chung-Chi Chen, Antonio Moreno-Sandoval, Jimin Huang, Qianqian Xie, Sophia Ananiadou, Hsin-Hsi Chen
Venues:
FinNLP | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
242–247
Language:
URL:
https://aclanthology.org/2025.finnlp-1.25/
DOI:
Bibkey:
Cite (ACL):
Avinash Trivedi, Gauri Toshniwal, Sangeetha S, and S R. Balasundaram. 2025. Sarang at FinCausal 2025: Contextual QA for Financial Causality Detection Combining Extractive and Generative Models. In Proceedings of the Joint Workshop of the 9th Financial Technology and Natural Language Processing (FinNLP), the 6th Financial Narrative Processing (FNP), and the 1st Workshop on Large Language Models for Finance and Legal (LLMFinLegal), pages 242–247, Abu Dhabi, UAE. Association for Computational Linguistics.
Cite (Informal):
Sarang at FinCausal 2025: Contextual QA for Financial Causality Detection Combining Extractive and Generative Models (Trivedi et al., FinNLP 2025)
Copy Citation:
PDF:
https://aclanthology.org/2025.finnlp-1.25.pdf