<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="card-2023-substitution">
    <titleInfo>
        <title>Substitution-based Semantic Change Detection using Contextual Embeddings</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Dallas</namePart>
        <namePart type="family">Card</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2023-07</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Anna</namePart>
            <namePart type="family">Rogers</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Jordan</namePart>
            <namePart type="family">Boyd-Graber</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Naoaki</namePart>
            <namePart type="family">Okazaki</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Toronto, Canada</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>Measuring semantic change has thus far remained a task where methods using contextual embeddings have struggled to improve upon simpler techniques relying only on static word vectors. Moreover, many of the previously proposed approaches suffer from downsides related to scalability and ease of interpretation. We present a simplified approach to measuring semantic change using contextual embeddings, relying only on the most probable substitutes for masked terms. Not only is this approach directly interpretable, it is also far more efficient in terms of storage, achieves superior average performance across the most frequently cited datasets for this task, and allows for more nuanced investigation of change than is possible with static word vectors.</abstract>
    <identifier type="citekey">card-2023-substitution</identifier>
    <identifier type="doi">10.18653/v1/2023.acl-short.52</identifier>
    <location>
        <url>https://aclanthology.org/2023.acl-short.52</url>
    </location>
    <part>
        <date>2023-07</date>
        <extent unit="page">
            <start>590</start>
            <end>602</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T Substitution-based Semantic Change Detection using Contextual Embeddings
%A Card, Dallas
%Y Rogers, Anna
%Y Boyd-Graber, Jordan
%Y Okazaki, Naoaki
%S Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)
%D 2023
%8 July
%I Association for Computational Linguistics
%C Toronto, Canada
%F card-2023-substitution
%X Measuring semantic change has thus far remained a task where methods using contextual embeddings have struggled to improve upon simpler techniques relying only on static word vectors. Moreover, many of the previously proposed approaches suffer from downsides related to scalability and ease of interpretation. We present a simplified approach to measuring semantic change using contextual embeddings, relying only on the most probable substitutes for masked terms. Not only is this approach directly interpretable, it is also far more efficient in terms of storage, achieves superior average performance across the most frequently cited datasets for this task, and allows for more nuanced investigation of change than is possible with static word vectors.
%R 10.18653/v1/2023.acl-short.52
%U https://aclanthology.org/2023.acl-short.52
%U https://doi.org/10.18653/v1/2023.acl-short.52
%P 590-602

Markdown (Informal)

[Substitution-based Semantic Change Detection using Contextual Embeddings](https://aclanthology.org/2023.acl-short.52) (Card, ACL 2023)

• Substitution-based Semantic Change Detection using Contextual Embeddings (Card, ACL 2023)

ACL

• Dallas Card. 2023. Substitution-based Semantic Change Detection using Contextual Embeddings. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pages 590–602, Toronto, Canada. Association for Computational Linguistics.