In-Context Learning for Upper Sorbian to German Translation: Comparing Lexical and Morpho-Syntactic Information

Qimin Sheng, Marion Di Marco, Alexander Fraser


Abstract
LLM-based translation remains challenging for low-resource languages, as LLMs often lack linguistic knowledge due to their limited representation in pre-training data. This is particularly problematic for morphologically rich languages where a large vocabulary can lead to further data sparsity.

Previous work has shown that providing external guidance on the source sentence in the form of language-specific information can help LLMs with tasks such as machine translation. In this study, we investigate zero-shot context augmentation for Upper Sorbian-to-German translation by enriching prompts with different types of contextual information: translation candidates in the form of bilingual dictionary entries, and morpho-syntactic analysis provided through morphological tagging. We first compare the effectiveness of these types of information in a zero-shot setting and then evaluate whether they generalize across additional experimental settings. We find that context-augmented prompting can improve Upper Sorbian-to-German translation. Contexts only containing translation candidates perform overall best, whereas morpho-syntactic analysis offers limited benefits, both on its own and in combination with lexical cues.
Anthology ID:
2026.wmt-main.39
Volume:
Proceedings of the Eleventh Conference on Machine Translation
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Barry Haddow, Tom Kocmi, Philipp Koehn, Christof Monz
Venues:
WMT | WS
SIG:
SIGMT
Publisher:
Association for Computational Linguistics
Note:
Pages:
698–710
Language:
URL:
https://aclanthology.org/2026.wmt-main.39/
DOI:
Bibkey:
Cite (ACL):
Qimin Sheng, Marion Di Marco, and Alexander Fraser. 2026. In-Context Learning for Upper Sorbian to German Translation: Comparing Lexical and Morpho-Syntactic Information. In Proceedings of the Eleventh Conference on Machine Translation, pages 698–710, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
In-Context Learning for Upper Sorbian to German Translation: Comparing Lexical and Morpho-Syntactic Information (Sheng et al., WMT 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.wmt-main.39.pdf