BaatCheet: A Multilingual Corpus for Dialogue Translation in Indian Languages

Priyanka Dasari, Yuvrajsinh Bodana, Vandan Mujadia, Arafat Ahsan, Dipti Sharma, Parameswari Krishnamurthy


Abstract
Existing translation models are typically trained on sentence-level and formal text, limiting their ability to capture everyday conversational dialogue phenomena such as informality, speaker interaction, and discourse coherence. Most existing Indic translation resources and evaluation benchmarks focus on sentence-level or formal text, making it difficult to assess translation quality of dialogue phenomena. In this work, we introduce BaatCheet, a multilingual dialogue corpus named after the Hindi term for conversation or chitchat, containing approximately 49,000 dialogues for dialogue translation across five translation directions. We fine-tune five open-source LLMs across seven training data configurations and find that fine-tuning yields substantial gains over zero- and few-shot baselines. To comprehensively evaluate dialogue translation quality, we employ multiple evaluation strategies, including automatic metrics, LLM-as-judge, and human assessments using an SQM-guided Direct Assessment (DA) Protocol.
Anthology ID:
2026.wmt-main.7
Volume:
Proceedings of the Eleventh Conference on Machine Translation
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Barry Haddow, Tom Kocmi, Philipp Koehn, Christof Monz
Venues:
WMT | WS
SIG:
SIGMT
Publisher:
Association for Computational Linguistics
Note:
Pages:
116–145
Language:
URL:
https://aclanthology.org/2026.wmt-main.7/
DOI:
Bibkey:
Cite (ACL):
Priyanka Dasari, Yuvrajsinh Bodana, Vandan Mujadia, Arafat Ahsan, Dipti Sharma, and Parameswari Krishnamurthy. 2026. BaatCheet: A Multilingual Corpus for Dialogue Translation in Indian Languages. In Proceedings of the Eleventh Conference on Machine Translation, pages 116–145, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
BaatCheet: A Multilingual Corpus for Dialogue Translation in Indian Languages (Dasari et al., WMT 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.wmt-main.7.pdf