<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="ecker-schneider-2026-multi">
    <titleInfo>
        <title>Multi-Label Text Classification of Derived Text Formats with DistilBERT</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Jennifer</namePart>
        <namePart type="family">Ecker</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Roman</namePart>
        <namePart type="family">Schneider</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2026-06</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of Leveraging Derived Text Formats to Unlock Copyrighted Collections for Open Science (DTF) @ LREC 2026</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Florian</namePart>
            <namePart type="family">Barth</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Keli</namePart>
            <namePart type="family">Du</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">José</namePart>
            <namePart type="family">Calvo Tello</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Philippe</namePart>
            <namePart type="family">Genêt</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Piroska</namePart>
            <namePart type="family">Lendvai</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Christof</namePart>
            <namePart type="family">Schöch</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Thorsten</namePart>
            <namePart type="family">Trippel</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>ELRA Language Resources Association (ELRA)</publisher>
            <place>
                <placeTerm type="text">Palma, Mallorca (Spain)</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>Derived Text Formats enable the distribution of copyrighted texts by systematically perturbing linguistic information to reduce reconstructability. However, the extent to which such information loss affects downstream text classification remains unclear. We investigate how controlled perturbations affect learning dynamics in transformer-based classification using two datasets and two strategies: POS-consistent replacement of 30%, 40%, and 50% of tokens, and random word-order shuffling. On Wikipedia data, POS replacement increases loss by 4-9% and reduces micro-F1 by 3-8%, depending on the replacement rate, while shuffling raises loss by 5% and lowers micro-F1 by 4%. Performance degrades monotonically with higher replacement rates, and shuffling yields results between the 30% and 40% conditions, indicating that DistilBERT relies more on lexical semantics than on word order. Experiments on specialist-domain data show the same pattern, demonstrating robustness across domains. To test cross-representation generalization, we train classifiers on both clean and perturbed texts and evaluate them on the respective alternate representation. Models trained on DTF data generalize better to clean text than vice versa, suggesting that perturbation-based training promotes more robust representations. Our findings position DTF as a promising strategy for reproducible, legally compliant, and robust NLP research.</abstract>
    <identifier type="citekey">ecker-schneider-2026-multi</identifier>
    <identifier type="doi">10.63317/4zbvre664my2</identifier>
    <location>
        <url>https://aclanthology.org/2026.dtf-1.5/</url>
    </location>
    <part>
        <date>2026-06</date>
        <extent unit="page">
            <start>34</start>
            <end>43</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T Multi-Label Text Classification of Derived Text Formats with DistilBERT
%A Ecker, Jennifer
%A Schneider, Roman
%Y Barth, Florian
%Y Du, Keli
%Y Calvo Tello, José
%Y Genêt, Philippe
%Y Lendvai, Piroska
%Y Schöch, Christof
%Y Trippel, Thorsten
%S Proceedings of Leveraging Derived Text Formats to Unlock Copyrighted Collections for Open Science (DTF) @ LREC 2026
%D 2026
%8 June
%I ELRA Language Resources Association (ELRA)
%C Palma, Mallorca (Spain)
%F ecker-schneider-2026-multi
%X Derived Text Formats enable the distribution of copyrighted texts by systematically perturbing linguistic information to reduce reconstructability. However, the extent to which such information loss affects downstream text classification remains unclear. We investigate how controlled perturbations affect learning dynamics in transformer-based classification using two datasets and two strategies: POS-consistent replacement of 30%, 40%, and 50% of tokens, and random word-order shuffling. On Wikipedia data, POS replacement increases loss by 4-9% and reduces micro-F1 by 3-8%, depending on the replacement rate, while shuffling raises loss by 5% and lowers micro-F1 by 4%. Performance degrades monotonically with higher replacement rates, and shuffling yields results between the 30% and 40% conditions, indicating that DistilBERT relies more on lexical semantics than on word order. Experiments on specialist-domain data show the same pattern, demonstrating robustness across domains. To test cross-representation generalization, we train classifiers on both clean and perturbed texts and evaluate them on the respective alternate representation. Models trained on DTF data generalize better to clean text than vice versa, suggesting that perturbation-based training promotes more robust representations. Our findings position DTF as a promising strategy for reproducible, legally compliant, and robust NLP research.
%R 10.63317/4zbvre664my2
%U https://aclanthology.org/2026.dtf-1.5/
%U https://doi.org/10.63317/4zbvre664my2
%P 34-43

Markdown (Informal)

[Multi-Label Text Classification of Derived Text Formats with DistilBERT](https://aclanthology.org/2026.dtf-1.5/) (Ecker & Schneider, DTF 2026)

• Multi-Label Text Classification of Derived Text Formats with DistilBERT (Ecker & Schneider, DTF 2026)

ACL

• Jennifer Ecker and Roman Schneider. 2026. Multi-Label Text Classification of Derived Text Formats with DistilBERT. In Proceedings of Leveraging Derived Text Formats to Unlock Copyrighted Collections for Open Science (DTF) @ LREC 2026, pages 34–43, Palma, Mallorca (Spain). ELRA Language Resources Association (ELRA).