Revisiting German Complex Word Identification: Contextualized LLMs and Feature Injection

Thorben Schomacker, Seid Muhie Yimam, Chris Biemann, Marina Tropmann-Frick


Abstract
Complex word identification (CWI) is essential in text simplification, yet work on German CWI remains comparatively limited. To address this gap, we investigate the capabilities of three state-of-the-art LLMs and compare them to previously proposed baseline systems. We fine-tune the LLMs in three setups: (i) using the target expression only, (ii) using the target expression together with its sentence-level context, and (iii) using the context and injection of classical machine learning features. Our results show that while pretrained-only LLMs fall short, fine-tuned LLMs set new benchmarks for both binary and probabilistic CWI. In addition, embedding the target in its context sentence improves performance, whereas feature injection has no clearly measurable effect. All models in this paper are trained on the probabilistic CWI task and additionally evaluated on the binary task; thus, we publish a single model that supports both evaluation views We released all accompanying resources (https://github.com/tschomacker/german-cwi-llm) and model checkpoints (https://huggingface.co/collections/tschomacker/german-cwi-llm).
Anthology ID:
2026.readi-1.1
Volume:
Proceedings of the Joint Workshop on Readability and Text Simplification (READIxTSAR) @ LREC 2026
Month:
May
Year:
2026
Address:
Palma, Mallorca (Spain)
Editors:
Matthew Shardlow, Thomas François, Raquel Amaro, Jorge Baptista, Rémi Cardon, Eugénio Ribeiro, Horacio Saggion, Regina Stodden, Amalia Todirascu, Rodrigo Wilkens
Venues:
READI | TSAR | WS
SIG:
Publisher:
ELRA Language Resources Association (ELRA)
Note:
Pages:
1–11
Language:
External URL:
https://lrec.elra.info/lrec2026-ws-readixtsar-01
DOI:
10.63317/4z33nthezmjs
Bibkey:
Cite (ACL):
Thorben Schomacker, Seid Muhie Yimam, Chris Biemann, and Marina Tropmann-Frick. 2026. Revisiting German Complex Word Identification: Contextualized LLMs and Feature Injection. In Proceedings of the Joint Workshop on Readability and Text Simplification (READIxTSAR) @ LREC 2026, pages 1–11, Palma, Mallorca (Spain). ELRA Language Resources Association (ELRA).
Cite (Informal):
Revisiting German Complex Word Identification: Contextualized LLMs and Feature Injection (Schomacker et al., READI-TSAR 2026)
Copy Citation: