Multilingual Reasoning Cascades Need More Context

Arnav Mazumder, Dengjia Zhang, Shuyue Stella Li, Yulia Tsvetkov, Niyati Bafna


Abstract
Translation cascades for reasoning translate the query from another language to English, reason in English, and translate the answer back to the original language. This is a competitive approach to multilingual reasoning, but structurally lossy, since each stage discards information later stages may need, including cues for cultural grounding, register, and disambiguation. We examine the benefits of a simple and training-free intervention: a context-aware translation cascade, which additionally provides the original question, the English-translated question, and the reasoning trace to the final cascade stage for target-language generation. We evaluate gains across ten multilingual benchmarks including various task types, three backbone models, and 285 high-, mid-, and low-resource languages, and demonstrate strong gains for open-ended generation across models and resource regimes. We show that the original language question carries most of the beneficial context. Our study emphasizes the need to better design information flow in multilingual reasoning cascades for mitigating error propagation, and provides a simple and actionable default strategy: preserve the original user question until the end of the pipeline.
Anthology ID:
2026.wmt-main.24
Volume:
Proceedings of the Eleventh Conference on Machine Translation
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Barry Haddow, Tom Kocmi, Philipp Koehn, Christof Monz
Venues:
WMT | WS
SIG:
SIGMT
Publisher:
Association for Computational Linguistics
Note:
Pages:
412–461
Language:
URL:
https://aclanthology.org/2026.wmt-main.24/
DOI:
Bibkey:
Cite (ACL):
Arnav Mazumder, Dengjia Zhang, Shuyue Stella Li, Yulia Tsvetkov, and Niyati Bafna. 2026. Multilingual Reasoning Cascades Need More Context. In Proceedings of the Eleventh Conference on Machine Translation, pages 412–461, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Multilingual Reasoning Cascades Need More Context (Mazumder et al., WMT 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.wmt-main.24.pdf