Financial Causal QA via Instruction and Prompt Tuning of Gemma3-12B

Avinash Trivedi, Chindukuri Mallikarjuna


Abstract
In this paper we present a novel methodology that harnesses the power of prompt tuning applied directly to Gemma3-12B, a state-of-the-art generative large language model to enhance performance on complex natural language processing challenges. Instead of relying solely on extensive retraining, our approach leverages carefully crafted input prompts to steer the pre-trained Gemma-12B towards generating outputs with superior contextual accuracy and interpretability. Our experimental evaluation employed a composite LLM Score metric that quantifies both semantic coherence and relevance; under this framework, our system (Team Name: Sarang) achieved a score of 4.54, ranking 9th in the shared task. Furthermore, in the competitive task evaluation, our method demonstrated the potential of prompt tuning as a viable alternative to traditional fine-tuning approaches. This study not only demonstrates the practical benefits of integrating prompt engineering with large language models but also opens avenues for future research aimed at further optimizing model performance in domain-specific applications.
Anthology ID:
2026.fnp-1.18
Volume:
The 7th Financial Narrative Processing Workshop
Month:
May
Year:
2026
Address:
Palma de Mallorca, Spain
Editors:
Mo El-Haj, Antonio Moreno Sandoval, Ana Garcia-Serrano, Chung-Chi Chen, Paul Rayson, Yanco Amor Torterolo Orta, Paloma Martinez, Jordi Porta
Venues:
FNP | WS
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
169–174
Language:
External URL:
https://lrec.elra.info/lrec2026-ws-fnp-18
DOI:
10.63317/24xxkstbkeqa
Bibkey:
Cite (ACL):
Avinash Trivedi and Chindukuri Mallikarjuna. 2026. Financial Causal QA via Instruction and Prompt Tuning of Gemma3-12B. In The 7th Financial Narrative Processing Workshop, pages 169–174, Palma de Mallorca, Spain. European Language Resources Association (ELRA).
Cite (Informal):
Financial Causal QA via Instruction and Prompt Tuning of Gemma3-12B (Trivedi & Mallikarjuna, FNP 2026)
Copy Citation: