Lightweight IPIS Instruction Tuning of Bielik-7B for Gender-Inclusive Polish<—>English Translation: System Description for PolEval 2025 Task 2 (IPIS-translation)

Mateusz Czajka


Abstract
We describe a compact but fully open-source system submitted to PolEval 2025 Task 2 (Gender-inclusive LLMs for Polish), subtask B: IPIS-translation. The goal of this subtask is gender-sensitive Polish↔English translation, including the production of gender-inclusive Polish outputs that follow specific orthographic conventions such as gender stars and slash forms. Our method performs instruction tuning of the Polish LLM Bielik-7B-Instruct using parameter-efficient LoRA adapters, with optional 4-bit NF4 quantization for single-GPU training. Samples from the Inclusive Polish Instruction Set (IPIS) are converted into a chat-style format with a task-provided gender-inclusive system prompt. Despite a deliberately lightweight tuning budget and greedy decoding, our submission placed 3rd on the hidden test B split, achieving bleu_pe = 20.7871. We detail the training and inference pipeline, discuss design choices and limitations, and outline directions for improving inclusive translation quality in Polish.
Anthology ID:
2025.poleval-main.10
Volume:
Proceedings of the PolEval 2025 Workshop
Month:
November
Year:
2025
Address:
Warsaw
Editors:
Łukasz Kobyliński, Alina Wróblewska, Maciej Ogrodniczuk
Venues:
PolEval | WS
SIG:
Publisher:
Institute of Computer Science PAS and Association for Computational Linguistics
Note:
Pages:
66–71
Language:
URL:
https://aclanthology.org/2025.poleval-main.10/
DOI:
Bibkey:
Cite (ACL):
Mateusz Czajka. 2025. Lightweight IPIS Instruction Tuning of Bielik-7B for Gender-Inclusive Polish<—>English Translation: System Description for PolEval 2025 Task 2 (IPIS-translation). In Proceedings of the PolEval 2025 Workshop, pages 66–71, Warsaw. Institute of Computer Science PAS and Association for Computational Linguistics.
Cite (Informal):
Lightweight IPIS Instruction Tuning of Bielik-7B for Gender-Inclusive Polish<—>English Translation: System Description for PolEval 2025 Task 2 (IPIS-translation) (Czajka, PolEval 2025)
Copy Citation:
PDF:
https://aclanthology.org/2025.poleval-main.10.pdf