Anne-Marie Lutgen
2026
A Subword Embedding Approach for Variation Detection in Luxembourgish User Comments
Anne-Marie Lutgen | Alistair Plum | Christoph Purschke
Proceedings of the 13th Workshop on NLP for Similar Languages, Varieties and Dialects
Anne-Marie Lutgen | Alistair Plum | Christoph Purschke
Proceedings of the 13th Workshop on NLP for Similar Languages, Varieties and Dialects
This paper presents an embedding-based approach to detecting variation without relying on prior normalisation or predefined variant lists. The method trains subword embeddings on raw text and groups related forms through combined cosine and n-gram similarity. This allows spelling and morphological diversity to be examined and analysed as linguistic structure rather than treated as noise. Using a large corpus of Luxembourgish user comments, the approach uncovers extensive lexical and orthographic variation that aligns with patterns described in dialectal and sociolinguistic research. The induced families capture systematic correspondences and highlight areas of regional and stylistic differentiation. The procedure does not strictly require manual annotation, but does produce transparent clusters that support both quantitative and qualitative analysis. The results demonstrate that distributional modelling can reveal meaningful patterns of variation even in “noisy” or low-resource settings, offering a reproducible methodological framework for studying language variety in multilingual and small-language contexts.
2025
Neural Text Normalization for Luxembourgish Using Real-Life Variation Data
Anne-Marie Lutgen | Alistair Plum | Christoph Purschke | Barbara Plank
Proceedings of the 12th Workshop on NLP for Similar Languages, Varieties and Dialects
Anne-Marie Lutgen | Alistair Plum | Christoph Purschke | Barbara Plank
Proceedings of the 12th Workshop on NLP for Similar Languages, Varieties and Dialects
Orthographic variation is very common in Luxembourgish texts due to the absence of a fully-fledged standard variety. Additionally, developing NLP tools for Luxembourgish is a difficult task given the lack of annotated and parallel data, which is exacerbated by ongoing standardization. In this paper, we propose the first sequence-to-sequence normalization models using the ByT5 and mT5 architectures with training data obtained from word-level real-life variation data. We perform a fine-grained, linguistically-motivated evaluation to test byte-based, word-based and pipeline-based models for their strengths and weaknesses in text normalization. We show that our sequence model using real-life variation data is an effective approach for tailor-made normalization in Luxembourgish.
2024
LuxBank: The First Universal Dependency Treebank for Luxembourgish
Alistair Plum | Caroline Döhmer | Emilia Milano | Anne-Marie Lutgen | Christoph Purschke
Proceedings of the 22nd Workshop on Treebanks and Linguistic Theories (TLT 2024)
Alistair Plum | Caroline Döhmer | Emilia Milano | Anne-Marie Lutgen | Christoph Purschke
Proceedings of the 22nd Workshop on Treebanks and Linguistic Theories (TLT 2024)
The Universal Dependencies (UD) project has significantly expanded linguistic coverage across 161 languages, yet Luxembourgish, a West Germanic language spoken by approximately 400,000 people, has remained absent until now. In this paper, we introduce LuxBank, the first UD Treebank for Luxembourgish, addressing the gap in syntactic annotation and analysis for this ‘low-research’ language. We establish formal guidelines for Luxembourgish language annotation, providing the foundation for the first large-scale quantitative analysis ofits syntax. LuxBank serves not only as a resource for linguists and language learners but also as a tool for developing spell checkers and grammar checkers, organising existing text archives and even training large language models. By incorporating Luxembourgish into the UD framework, we aim to enhance the understanding of syntactic variation within West Germanic languages and offer a model for documenting smaller, semi-standardised languages. This work positions Luxembourgish as a valuable resource in the broader linguistic and NLP communities, contributing to the study of languages with limited research and resources.