Marlies Alber

Author directory

2026

This paper investigates how gender-fair strategies in source texts influence the production of non-binary translations in the Italian to German combination. We make use of a controlled test set featuring both binary and non-binary approaches to assess their effectiveness for non-binary renderings in the target language. We also introduce an automatic evaluation framework that classifies target sentences into four categories: non-binary, binary-gendered, single-gendered, and incoherent. Relying on human annotation and analysis, we compare Reasoning LLMs against standard inference, examining whether reasoning improves translation quality and automatic evaluation. Our results show that reasoning models are more successful in shifting from binary to non-binary formulations and in handling linguistic challenges such as epicene terms and special characters, although there are no improvements in sentence-level consistency and evaluation accuracy. A qualitative analysis of German translations shows that reasoning encourages the reformulation of source-side strategies through neutralization, visibility strategies, and paraphrasing, resulting in more natural target texts.
Term injection in machine translation is undergoing a paradigm shift in the era of large language models (LLMs). Although recent shared-task results suggest near-saturation for sentence-level term injection from pre-defined glossaries, it remains unclear whether this also holds in more challenging settings. We address this question with a custom test set for legal translation from Italian into South Tyrolean German, a non-dominant and under-resourced language variety. We cover three terminology challenges: simple term injection, localisation of abbreviated forms, and homonym disambiguation. We focus on Reasoning Models (RMs) leveraging Test-Time Scaling, comparing them with different architectures and contributing a human analysis of reasoning traces. We find that reasoning offers little benefit for simple term insertion, but yields clear gains for semantically complex cases such as homonym disambiguation. However, human evaluation of reasoning traces shows that these gains do not necessarily reflect robust and factually grounded translation-specific reasoning. We further show that without external terminological resources, even state-of-the-art RMs struggle to retrieve correct terminology for a non-dominant variety, while NMT small models remain competitive when trained on in-domain bilingual corpora. Based on these findings, we propose data collection strategies for inducing translation-specific reasoning, frameworks for adapting to and evaluating terminology across many language varieties, and terminology challenges beyond simple term injection.

2025

We investigate the effect of terminology injection for terminology-constrained translation in a low-resource language variety, with a particular focus on off-the-shelf instruction-tuned Large Language Models (LLMs). We compare a total of 9 models: 4 instruction-tuned LLMs from the Tower and EuroLLM suites, which have been specifically trained for translation-related tasks; 2 generic open-weight LLMs (LLaMA-8B and Mistral-7B); 3 Neural Machine Translation (NMT) systems (an adapted version of MarianMT and ModernMT with and without the glossary function). To this end, we release LegISTyr, a manually curated test set of 2,000 Italian sentences from the legal domain, paired with source Italian terms and target terms in the South Tyrolean standard variety of German. We select only real-world sources and design constraints on length, syntactic clarity, and referential coherence to ensure high quality. LegISTyr includes a homonym subset, which challenges systems on the selection of the correct homonym where sense disambiguation is deducible from the context. Results show that while generic LLMs achieve the highest raw term insertion rates (approximately 64%), translation-specialized LLMs deliver superior fluency (∆ COMET up to 0.04), reduce incorrect homonym selection by half, and generate more controllable output. We posit that models trained on translation-related data are better able to focus on source-side information, producing more coherent translations.