Reasoning about In-Context Samples for Machine-Translation

Maxime Bouthors, Josep Crego, François Yvon


Abstract
Large Language Models (LLMs) can be trained to perform chain-of-thoughts reasoning in order to improve the reliability of their responses. In this work, we investigate how explicit reasoning can be leveraged for Machine Translation (MT). We introduce a novel fragment-based reasoning framework in which the model first extracts parallel source-target fragments from retrieved similar examples, and uses these fragments as intermediate reasoning traces to produce the final translation. To train our model, we distill silver fragments and drafts from a larger teacher model. Our experiments with the Qwen3 model family, over 6 languages, including up to 5 domains per language, demonstrates that fragment-based MT significantly outperforms alternative methods like standard k-shot, or drafting.
Anthology ID:
2026.findings-emnlp.168
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
3546–3566
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.168/
DOI:
Bibkey:
Cite (ACL):
Maxime Bouthors, Josep Crego, and François Yvon. 2026. Reasoning about In-Context Samples for Machine-Translation. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 3546–3566, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Reasoning about In-Context Samples for Machine-Translation (Bouthors et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.168.pdf