HexaBee-4B: Six-Language Translation with Multilingual Answering and Bidirectional Supervision

Iman Barati, Mohammadmostafa Rostamkhani, Mohammad Badzohreh


Abstract
Multilingual translation requires a model to preserve meaning while producing text in a requested language. We present HEXABEE-4B, a translator adapted from Gemma 3 4B IT through three stages: Wikipedia continued pretraining, joint multilingual answering and answer-text translation, and bidirectional translation specialization. The intermediate stage connects two tasks through shared multilingual answers: answering a question in the requested language and translating an answer into that language. It comprises 19.46 million answering records, including 5.76 million cross-language question–answer pairs, and 10.70 million answer-text translations. The final stage uses 658,274 forward and reverse synthetic translation examples. On 36,572 synthetic test examples spanning all 30 directions among Arabic, Chinese, English, Hebrew, Persian, and Spanish, HEXABEE-4B achieves direction-macro chrF++ of 73.75, compared with 57.11 for Gemma 3 4B IT and 66.83 for Gemma 3 12B IT. BLEU, TER, COMET, and a matched model-judged subset support the same overall ranking. These results demonstrate improved translation on the evaluated synthetic distribution, with chrF++ gains in every evaluated direction over both baselines.
Anthology ID:
2026.wat-1.4
Volume:
Proceedings of the Thirteenth Workshop on Asian Translation (WAT 2026)
Month:
November
Year:
2026
Address:
Hengqin, China
Editors:
Toshiaki Nakazawa, Isao Goto
Venues:
WAT | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
46–70
Language:
URL:
https://aclanthology.org/2026.wat-1.4/
DOI:
Bibkey:
Cite (ACL):
Iman Barati, Mohammadmostafa Rostamkhani, and Mohammad Badzohreh. 2026. HexaBee-4B: Six-Language Translation with Multilingual Answering and Bidirectional Supervision. In Proceedings of the Thirteenth Workshop on Asian Translation (WAT 2026), pages 46–70, Hengqin, China. Association for Computational Linguistics.
Cite (Informal):
HexaBee-4B: Six-Language Translation with Multilingual Answering and Bidirectional Supervision (Barati et al., WAT 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.wat-1.4.pdf