PSK at WMT 2026 MIST: Task-Specialized QLoRA Adapters for Multilingual Summarization and Question Answering

Srikar Kashyap Pulipaka


Abstract
We describe the PSK submission to the WMT 2026 Multilingual Instruction Shared Task. Our system uses the 3.35B-parameter Tiny Aya Global model with three QLoRA adapters, one for each task. The adapters are trained on multilingual document–summary pairs, passage-based question answering, and filtered standalone question answering. The summarization data also includes scientific papers with their author-written abstracts. On our held-out split, the context and summarization adapters perform better than our multitask adapter, while results for open QA are mixed. Official evaluation ranks PSK sixth overall and fourth for summarization. Context QA and open QA remain weaker, and the multitask open-QA route outperforms both specialized open-QA adapters.
Anthology ID:
2026.wmt-main.131
Volume:
Proceedings of the Eleventh Conference on Machine Translation
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Barry Haddow, Tom Kocmi, Philipp Koehn, Christof Monz
Venues:
WMT | WS
SIG:
SIGMT
Publisher:
Association for Computational Linguistics
Note:
Pages:
1959–1964
Language:
URL:
https://aclanthology.org/2026.wmt-main.131/
DOI:
Bibkey:
Cite (ACL):
Srikar Kashyap Pulipaka. 2026. PSK at WMT 2026 MIST: Task-Specialized QLoRA Adapters for Multilingual Summarization and Question Answering. In Proceedings of the Eleventh Conference on Machine Translation, pages 1959–1964, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
PSK at WMT 2026 MIST: Task-Specialized QLoRA Adapters for Multilingual Summarization and Question Answering (Pulipaka, WMT 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.wmt-main.131.pdf