---
title: "Financial Causal QA via Instruction and Prompt Tuning of"
description: "The paper describes team Sarang's entry to the FinCausal 2026 shared task. 20 references, cited by 1 paper here."
authors: ["Avinash Trivedi", "Chindukuri Mallikarjuna"]
year: 2026
venue: "The 7th Financial Narrative Processing Workshop"
source: "https://aclanthology.org/2026.fnp-1.18/"
doi: "10.63317/24xxkstbkeqa"
licence: "CC BY-NC 4.0 (ELRA, LREC proceedings)"
licence_url: "https://creativecommons.org/licenses/by-nc/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/trivedi-2026-financial-causal-qa-instruction-prompt/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/trivedi-2026-financial-causal-qa-instruction-prompt/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/12/) / Financial Causal QA via Instruction and Prompt Tuning of Gemma3-12B

# Financial Causal QA via Instruction and Prompt Tuning of Gemma3-12B

**Authors:** Avinash Trivedi and Chindukuri Mallikarjuna · **Year:** 2026 · **Venue:** [The 7th Financial Narrative Processing Workshop](https://md.research.elamur.ai/free/en/venues/fnp/) ([Financial Narrative Processing Workshop 2026](https://md.research.elamur.ai/free/en/venues/fnp/2026/)) · **Publisher:** [European Language Resources Association (ELRA)](https://md.research.elamur.ai/free/en/publishers/european-language-resources-association-elra/) · **Licence:** [CC BY-NC 4.0 (ELRA, LREC proceedings)](https://creativecommons.org/licenses/by-nc/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.fnp-1.18/) · [PDF](https://aclanthology.org/2026.fnp-1.18.pdf) · [DOI 10.63317/24xxkstbkeqa](https://doi.org/10.63317/24xxkstbkeqa) · [OpenAlex](https://openalex.org/W7166524735)

**Citations:** 0 citations (OpenAlex, 2026-10-14) · [1](https://md.research.elamur.ai/free/en/papers/trivedi-2026-financial-causal-qa-instruction-prompt/cited-by/) in our library, of the 149,439 papers whose bibliographies we read

## Summary
The paper describes team Sarang's entry to the FinCausal 2026 shared task. Given a financial passage and a question, a system must return the cause or the effect it asks about as a span taken from the passage. Answers are scored by an LLM-as-a-judge metric (LLM Score) that rewards meaning rather than exact span overlap. The authors used the English FinCausal 2026 QA dataset and compared two families of approaches. The first was fine-tuning extractive QA encoders (RoBERTa and DeBERTa checkpoints), optionally followed by an LLM pass that checks the answer and corrects it against the context. The second was few-shot prompting of local instruction-tuned LLMs run through Ollama. Their best system did not update any weights. It tuned the instruction and demonstrations for Gemma3-12B automatically with DSPy's MIPROv2 optimizer. This reached an LLM Score of 4.54 and placed 9th. The study suggests that automated prompt optimization of a mid-sized open model can beat task-specific fine-tuning on causal financial QA.

## Key points
- **Data:** The English FinCausal 2026 QA set has 2,000 training and 500 test instances. Each instance contains an ID, Context, Question and Answer, and the test set has no answers.
- **Fine-tuning baselines:**
  - consciousAI/question-answering-roberta-base-s scored 4.136, rising to 4.288 with the LLM answer-correction step.
  - deepset/deberta-v3-large-squad2 scored 4.292, rising to 4.302 with the same step.
- **Few-shot LLMs without tuning:** gemma2:latest scored 4.424 and qwen3:latest scored 4.418, both above every fine-tuned model.
- **Prompt optimization with MIPROv2 on gemma3:12b:** "light" optimization gave 4.448 and "medium" gave 4.54. The best run used auto=medium, max_bootstrapped_demos=10 and max_labeled_demos=10.
- **Note on the title:** despite the mention of "instruction tuning", Gemma3-12B itself was never trained. Gains came only from optimizing the prompt and demonstrations.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

Also on the byline: [SRM University, Andhra Pradesh](https://ror.org/013vs5h31).

📚 Shelves (4): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works

🧭 Topics (1): [❓ Question answering](https://md.research.elamur.ai/free/en/topics/question-answering/) · 441 works

## Cite

Cite as: Avinash Trivedi and Chindukuri Mallikarjuna. 2026. Financial Causal QA via Instruction and Prompt Tuning of Gemma3-12B. The 7th Financial Narrative Processing Workshop.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{trivedi2026financial,
  title = {{Financial Causal QA via Instruction and Prompt Tuning of Gemma3-12B}},
  author = {Avinash Trivedi and Chindukuri Mallikarjuna},
  booktitle = {The 7th Financial Narrative Processing Workshop},
  year = {2026},
  doi = {10.63317/24xxkstbkeqa},
  url = {https://doi.org/10.63317/24xxkstbkeqa}
}
```

- [← previous FFT-UniBa at Cruciverb-IT: Special Length Tokens and CSP for Italian Crossword Solving](https://md.research.elamur.ai/free/en/papers/porcelli-2026-fft-uniba-cruciverb-it-special/)
- [next → FinCall-Surprise: A Large Scale Multi-modal Benchmark for Earning Surprise Prediction](https://md.research.elamur.ai/free/en/papers/shu-2026-fincall-surprise-large-scale-multi/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/12/)

## References

20 references, 9 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al. 2020. [Language models are few-shot learners](https://md.research.elamur.ai/free/en/papers/brown-2020-language-models-few-shot-learners/). Advances in neural information processing systems, 33:1877–1901.
2. Zhiyu Chen, Wenhu Chen, Charese Smiley, Sameena Shah, Iana Borova, Dylan Langdon, Reema Moussa, Matt Beane, Ting-Hao Huang, Bryan Routledge, and William Yang Wang. 2021. [Finqa: A dataset of numerical reasoning over financial data](https://md.research.elamur.ai/free/en/papers/chen-2021-finqa-dataset-numerical-reasoning-over/). In Proceedings of the 2021 Conference on Empirical Methods in Natural…
3. Team Gemma and Google DeepMind. 2024. Gemma: Open models based on gemini research and technology. arXiv preprint arXiv:2403.08295. [find](https://scholar.google.com/scholar?q=Team+Gemma+and+Google+DeepMind%2E+2024%2E+Gemma%3A+Open+models+based+on+gemini+research+and+technology%2E+arXiv+preprint+arXiv%3A2403%2E08295%2E)
4. Omar Khattab, Keshav Santhanam, Xiang Lisa Li, David Hall, Percy Liang, Christopher Potts, and Matei Zaharia. 2022. [Demonstrate-search-predict: Composing retrieval and language models for knowledge-intensive NLP](https://md.research.elamur.ai/free/en/papers/khattab-2022-demonstrate-search-predict-composing-retrieval/). arXiv preprint arXiv:2212.14024.
5. Omar Khattab, Arnav Singhvi, Paridhi Maheshwari, Zhiyuan Zhang, Keshav Santhanam, Sri Vardhamanan, Saiful Haq, Ashutosh Sharma, Thomas T. Joshi, Hanna Moazam, Heather Miller, Matei Zaharia, and Christopher Potts. 2024. [Dspy: Compiling declarative language model calls into self-improving pipelines](https://md.research.elamur.ai/free/en/papers/khattab-2023-dspy-compiling-declarative-language-model/).
6. Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019. [Roberta: A robustly optimized bert pretraining approach](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/). arXiv preprint arXiv:1907.11692.
7. Man Luo, Kazuma Hashimoto, Semih Yavuz, Zhiwei Liu, Chitta Baral, and Yingbo Zhou. 2022. Choose your qa model wisely: A systematic study of generative and extractive readers for question answering. In Proceedings of the 1st Workshop on Semiparametric Methods in NLP: Decoupling Logic from Knowledge,… [find](https://scholar.google.com/scholar?q=Man+Luo%2C+Kazuma+Hashimoto%2C+Semih+Yavuz%2C+Zhiwei+Liu%2C+Chitta+Baral%2C+and+Yingbo+Zhou%2E+2022%2E+Choose+your+qa+model+wisely%3A+A+systematic+study+of+generative+and+extractive+readers+for+question+answering%2E+In)
8. Dominique Mariko, Hanna Abi-Akl, Estelle Labidurie, Stephane Durfort, Hugues De Mazancourt, and Mahmoud El-Haj. 2020. The financial document causality detection shared task (fincausal 2020). In Proceedings of the 1st Joint Workshop on Financial Narrative Processing and MultiLing Financial Summarisat… [find](https://scholar.google.com/scholar?q=Dominique+Mariko%2C+Hanna+Abi%2DAkl%2C+Estelle+Labidurie%2C+Stephane+Durfort%2C+Hugues+De+Mazancourt%2C+and+Mahmoud+El%2DHaj%2E+2020%2E+The+financial+document+causality+detection+shared+task+%28fincausal+2020%29%2E+In+Procee)
9. Neurips 2020 efficientqa competition: Systems, analyses and lessons learned. In Proceedings of the NeurIPS 2020 Competition and Demonstration Track, volume 133 of PMLR, pages 86–111. [find](https://scholar.google.com/scholar?q=Neurips+2020+efficientqa+competition%3A+Systems%2C+analyses+and+lessons+learned%2E+In+Proceedings+of+the+NeurIPS+2020+Competition+and+Demonstration+Track%2C+volume+133+of+PMLR%2C+pages+86%E2%80%93111%2E)
10. Antonio Moreno-Sandoval, Blanca Carbajo Coronado, Jordi Porta Zamorano, Yanco Amor Torterolo Orta, and Doaa Samy. 2025. The financial document causality detection shared task (fincausal 2025). In Proceedings of the Joint Workshop of the 9th Financial Technology and Natural Language Processing (FinNL… [find](https://scholar.google.com/scholar?q=Antonio+Moreno%2DSandoval%2C+Blanca+Carbajo+Coronado%2C+Jordi+Porta+Zamorano%2C+Yanco+Amor+Torterolo+Orta%2C+and+Doaa+Samy%2E+2025%2E+The+financial+document+causality+detection+shared+task+%28fincausal+2025%29%2E+In+Proc)
11. Antonio Moreno-Sandoval, Jordi Porta, Yanco Torterolo, Alexia Stanescu, Melina Chatzi, and Sofía Roseti. 2026a. [find](https://scholar.google.com/scholar?q=Antonio+Moreno%2DSandoval%2C+Jordi+Porta%2C+Yanco+Torterolo%2C+Alexia+Stanescu%2C+Melina+Chatzi%2C+and+Sof%C3%ADa+Roseti%2E+2026a%2E)
12. [The Financial Document Causality Detection Shared Task (FinCausal 2026)](https://md.research.elamur.ai/free/en/papers/sandoval-2026-financial-document-causality-detection-shared/). In Proceedings of the 7th Financial Narrative Processing Workshop (FNP 2026) at LREC 2026, Palma de Mallorca, Spain. ELRA.
13. Antonio Moreno-Sandoval, Yanco Amor Torterolo Orta, Maria Alexia Stanescu, and Melina Chatzi. 2026b. [find](https://scholar.google.com/scholar?q=Antonio+Moreno%2DSandoval%2C+Yanco+Amor+Torterolo+Orta%2C+Maria+Alexia+Stanescu%2C+and+Melina+Chatzi%2E+2026b%2E)
14. [The Financial Document Causality Detection Shared Task (FinCausal 2026)](https://md.research.elamur.ai/free/en/papers/sandoval-2026-financial-document-causality-detection-shared/): Dataset.
15. Antonio Moreno-Sandoval, Jordi Porta Zamorano, Blanca Carbajo-Coronado, Doaa Samy, Dominique Mariko, and Mahmoud El-Haj. 2023. The financial document causality detection shared task (fincausal 2023). In Proceedings of the 2023 IEEE International Conference on Big Data (Big-Data 2023), pages 2855–286… [find](https://scholar.google.com/scholar?q=Antonio+Moreno%2DSandoval%2C+Jordi+Porta+Zamorano%2C+Blanca+Carbajo%2DCoronado%2C+Doaa+Samy%2C+Dominique+Mariko%2C+and+Mahmoud+El%2DHaj%2E+2023%2E+The+financial+document+causality+detection+shared+task+%28fincausal+2023%29%2E+)
16. Dominique Mariko, Hanna Abi-Akl, Kim Trottier, and Mahmoud El-Haj. 2022. The financial causality extraction shared task (fincausal 2022). In Proceedings of the 4th Financial Narrative Processing Workshop @LREC2022, pages 105– 107, Marseille, France. European Language Resources Association. [find](https://scholar.google.com/scholar?q=Dominique+Mariko%2C+Hanna+Abi%2DAkl%2C+Kim+Trottier%2C+and+Mahmoud+El%2DHaj%2E+2022%2E+The+financial+causality+extraction+shared+task+%28fincausal+2022%29%2E+In+Proceedings+of+the+4th+Financial+Narrative+Processing+Works)
17. Jonathan Pilault, Raymond Li, Sandeep Subramanian, and Chris Pal. 2020. [On extractive and abstractive neural document summarization with transformer language models](https://md.research.elamur.ai/free/en/papers/pilault-2020-extractive-abstractive-neural-document-summarization/). In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP 2020), pages 9308–9319. Association f…
18. Dominique Mariko, Hanna Abi Akl, Estelle Labidurie, Stephane Durfort, Hugues de Mazan-Avinash Trivedi, Gauri Toshniwal, Sivanesan Sangeetha, and SR Balasundaram. 2025. [find](https://scholar.google.com/scholar?q=Dominique+Mariko%2C+Hanna+Abi+Akl%2C+Estelle+Labidurie%2C+Stephane+Durfort%2C+Hugues+de+Mazan%2DAvinash+Trivedi%2C+Gauri+Toshniwal%2C+Sivanesan+Sangeetha%2C+and+SR+Balasundaram%2E+2025%2E)
19. Sarang at fincausal 2025: Contextual qa for financial causality detection combining extractive and generative models. In Proceedings of the Joint Workshop of the 9th Financial Technology and Natural Language Processing (FinNLP), the 6th Financial Narrative Processing (FNP), and the 1st Workshop on L… [find](https://scholar.google.com/scholar?q=Sarang+at+fincausal+2025%3A+Contextual+qa+for+financial+causality+detection+combining+extractive+and+generative+models%2E+In+Proceedings+of+the+Joint+Workshop+of+the+9th+Financial+Technology+and+Natural+L)
20. Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Fei Xia, Ed Chi, Quoc V Le, Denny Zhou, et al. 2022. [Chain-of-thought prompting elicits reasoning in large language models](https://md.research.elamur.ai/free/en/papers/wei-2022-chain-thought-prompting-elicits-reasoning/). Advances in neural information processing systems, 35:24824–24837.

*Updated 31 October 2026*