<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="paik-wense-2025-effectiveness">
    <titleInfo>
        <title>The Effectiveness of Uncased Tokeniziaion for Clinical Notes</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Cory</namePart>
        <namePart type="family">Paik</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Katharina</namePart>
        <namePart type="given">Von</namePart>
        <namePart type="given">Der</namePart>
        <namePart type="family">Wense</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2025-07</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Findings of the Association for Computational Linguistics: ACL 2025</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Wanxiang</namePart>
            <namePart type="family">Che</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Joyce</namePart>
            <namePart type="family">Nabende</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Ekaterina</namePart>
            <namePart type="family">Shutova</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Mohammad</namePart>
            <namePart type="given">Taher</namePart>
            <namePart type="family">Pilehvar</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Vienna, Austria</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
        <identifier type="isbn">979-8-89176-256-5</identifier>
    </relatedItem>
    <abstract>The impact of case-sensitive tokenization on clinical notes is not well understood. While clinical notes share similarities with biomedical text in terminology, they often lack the proper casing found in polished publications. Language models, unlike humans, require a fixed vocabulary and case sensitivity is a trade-off that must be considered carefully. Improper casing can lead to sub-optimal tokenization and increased sequence length, degrading downstream performance and increasing computational costs. While most recent open-domain encoder language models use uncased tokenization for all tasks, there is no clear trend in biomedical and clinical models. In this work we (1) show that uncased models exceed the performance of cased models on clinical notes, even on traditionally case-sensitive tasks such as named entity recognition and (2) introduce independent case encoding to better balance model performance on case-sensitive and improperly-cased tasks.</abstract>
    <identifier type="citekey">paik-wense-2025-effectiveness</identifier>
    <identifier type="doi">10.18653/v1/2025.findings-acl.775</identifier>
    <location>
        <url>https://aclanthology.org/2025.findings-acl.775/</url>
    </location>
    <part>
        <date>2025-07</date>
        <extent unit="page">
            <start>14986</start>
            <end>14992</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T The Effectiveness of Uncased Tokeniziaion for Clinical Notes
%A Paik, Cory
%A Wense, Katharina Von Der
%Y Che, Wanxiang
%Y Nabende, Joyce
%Y Shutova, Ekaterina
%Y Pilehvar, Mohammad Taher
%S Findings of the Association for Computational Linguistics: ACL 2025
%D 2025
%8 July
%I Association for Computational Linguistics
%C Vienna, Austria
%@ 979-8-89176-256-5
%F paik-wense-2025-effectiveness
%X The impact of case-sensitive tokenization on clinical notes is not well understood. While clinical notes share similarities with biomedical text in terminology, they often lack the proper casing found in polished publications. Language models, unlike humans, require a fixed vocabulary and case sensitivity is a trade-off that must be considered carefully. Improper casing can lead to sub-optimal tokenization and increased sequence length, degrading downstream performance and increasing computational costs. While most recent open-domain encoder language models use uncased tokenization for all tasks, there is no clear trend in biomedical and clinical models. In this work we (1) show that uncased models exceed the performance of cased models on clinical notes, even on traditionally case-sensitive tasks such as named entity recognition and (2) introduce independent case encoding to better balance model performance on case-sensitive and improperly-cased tasks.
%R 10.18653/v1/2025.findings-acl.775
%U https://aclanthology.org/2025.findings-acl.775/
%U https://doi.org/10.18653/v1/2025.findings-acl.775
%P 14986-14992

Markdown (Informal)

[The Effectiveness of Uncased Tokeniziaion for Clinical Notes](https://aclanthology.org/2025.findings-acl.775/) (Paik & Wense, Findings 2025)

• The Effectiveness of Uncased Tokeniziaion for Clinical Notes (Paik & Wense, Findings 2025)

ACL

• Cory Paik and Katharina Von Der Wense. 2025. The Effectiveness of Uncased Tokeniziaion for Clinical Notes. In Findings of the Association for Computational Linguistics: ACL 2025, pages 14986–14992, Vienna, Austria. Association for Computational Linguistics.