A Long Hard Look at MWEs in the Age of Language Models

Vered Shwartz

doi:10.18653/v1/2021.mwe-1.1

A Long Hard Look at MWEs in the Age of Language Models

Correct Metadata for

Important: The Anthology treat PDFs as authoritative. Please use this form only to correct data that is out of line with the PDF. See our corrections guidelines if you need to change the PDF.

Title Adjust the title. Retain tags such as <fixed-case>.

Authors Adjust author names and order to match the PDF.

Abstract Correct abstract if needed. Retain XML formatting tags such as <tex-math>.

Verification against PDF Ensure that the new title/authors match the snapshot below. (If there is no snapshot or it is too small, consult the PDF.)

Authors concatenated from the text boxes above:

ALL author names match the snapshot above—including middle initials, hyphens, and accents.

Abstract

In recent years, language models (LMs) have become almost synonymous with NLP. Pre-trained to “read” a large text corpus, such models are useful as both a representation layer as well as a source of world knowledge. But how well do they represent MWEs? This talk will discuss various problems in representing MWEs, and the extent to which LMs address them: • Do LMs capture the implicit relationship between constituents in compositional MWEs (from baby oil through parsley cake to cheeseburger stabbing)? • Do LMs recognize when words are used nonliterally in non-compositional MWEs (e.g. do they know whether there are fleas in the flea market)? • Do LMs know idioms, and can they infer the meaning of new idioms from the context as humans often do?

Anthology ID:: 2021.mwe-1.1
Volume:: Proceedings of the 17th Workshop on Multiword Expressions (MWE 2021)
Month:: August
Year:: 2021
Address:: Online
Editors:: Paul Cook, Jelena Mitrović, Carla Parra Escartín, Ashwini Vaidya, Petya Osenova, Shiva Taslimipoor, Carlos Ramisch
Venue:: MWE
SIG:: SIGLEX
Publisher:: Association for Computational Linguistics
Note:
Pages:: 1
Language:
URL:: https://aclanthology.org/2021.mwe-1.1/
DOI:: 10.18653/v1/2021.mwe-1.1
Bibkey:
Cite (ACL):: Vered Shwartz. 2021. A Long Hard Look at MWEs in the Age of Language Models. In Proceedings of the 17th Workshop on Multiword Expressions (MWE 2021), page 1, Online. Association for Computational Linguistics.
Cite (Informal):: A Long Hard Look at MWEs in the Age of Language Models (Shwartz, MWE 2021)
Copy Citation:
PDF:: https://aclanthology.org/2021.mwe-1.1.pdf

PDF Cite Search Fix data

Export citation

BibTeX
MODS XML
Endnote
Preformatted

@inproceedings{shwartz-2021-long,
    title = "A Long Hard Look at {MWE}s in the Age of Language Models",
    author = "Shwartz, Vered",
    editor = "Cook, Paul  and
      Mitrovi{\'c}, Jelena  and
      Escart{\'i}n, Carla Parra  and
      Vaidya, Ashwini  and
      Osenova, Petya  and
      Taslimipoor, Shiva  and
      Ramisch, Carlos",
    booktitle = "Proceedings of the 17th Workshop on Multiword Expressions (MWE 2021)",
    month = aug,
    year = "2021",
    address = "Online",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/2021.mwe-1.1/",
    doi = "10.18653/v1/2021.mwe-1.1",
    pages = "1",
    abstract = "In recent years, language models (LMs) have become almost synonymous with NLP. Pre-trained to {\textquotedblleft}read{\textquotedblright} a large text corpus, such models are useful as both a representation layer as well as a source of world knowledge. But how well do they represent MWEs? This talk will discuss various problems in representing MWEs, and the extent to which LMs address them: {\textbullet} Do LMs capture the implicit relationship between constituents in compositional MWEs (from baby oil through parsley cake to cheeseburger stabbing)? {\textbullet} Do LMs recognize when words are used nonliterally in non-compositional MWEs (e.g. do they know whether there are fleas in the flea market)? {\textbullet} Do LMs know idioms, and can they infer the meaning of new idioms from the context as humans often do?"
}

Download as File

<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="shwartz-2021-long">
    <titleInfo>
        <title>A Long Hard Look at MWEs in the Age of Language Models</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Vered</namePart>
        <namePart type="family">Shwartz</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2021-08</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the 17th Workshop on Multiword Expressions (MWE 2021)</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Paul</namePart>
            <namePart type="family">Cook</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Jelena</namePart>
            <namePart type="family">Mitrović</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Carla</namePart>
            <namePart type="given">Parra</namePart>
            <namePart type="family">Escartín</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Ashwini</namePart>
            <namePart type="family">Vaidya</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Petya</namePart>
            <namePart type="family">Osenova</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Shiva</namePart>
            <namePart type="family">Taslimipoor</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Carlos</namePart>
            <namePart type="family">Ramisch</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Online</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>In recent years, language models (LMs) have become almost synonymous with NLP. Pre-trained to “read” a large text corpus, such models are useful as both a representation layer as well as a source of world knowledge. But how well do they represent MWEs? This talk will discuss various problems in representing MWEs, and the extent to which LMs address them: • Do LMs capture the implicit relationship between constituents in compositional MWEs (from baby oil through parsley cake to cheeseburger stabbing)? • Do LMs recognize when words are used nonliterally in non-compositional MWEs (e.g. do they know whether there are fleas in the flea market)? • Do LMs know idioms, and can they infer the meaning of new idioms from the context as humans often do?</abstract>
    <identifier type="citekey">shwartz-2021-long</identifier>
    <identifier type="doi">10.18653/v1/2021.mwe-1.1</identifier>
    <location>
        <url>https://aclanthology.org/2021.mwe-1.1/</url>
    </location>
    <part>
        <date>2021-08</date>
        <detail type="page"><number>1</number></detail>
    </part>
</mods>
</modsCollection>

Download as File

%0 Conference Proceedings
%T A Long Hard Look at MWEs in the Age of Language Models
%A Shwartz, Vered
%Y Cook, Paul
%Y Mitrović, Jelena
%Y Escartín, Carla Parra
%Y Vaidya, Ashwini
%Y Osenova, Petya
%Y Taslimipoor, Shiva
%Y Ramisch, Carlos
%S Proceedings of the 17th Workshop on Multiword Expressions (MWE 2021)
%D 2021
%8 August
%I Association for Computational Linguistics
%C Online
%F shwartz-2021-long
%X In recent years, language models (LMs) have become almost synonymous with NLP. Pre-trained to “read” a large text corpus, such models are useful as both a representation layer as well as a source of world knowledge. But how well do they represent MWEs? This talk will discuss various problems in representing MWEs, and the extent to which LMs address them: • Do LMs capture the implicit relationship between constituents in compositional MWEs (from baby oil through parsley cake to cheeseburger stabbing)? • Do LMs recognize when words are used nonliterally in non-compositional MWEs (e.g. do they know whether there are fleas in the flea market)? • Do LMs know idioms, and can they infer the meaning of new idioms from the context as humans often do?
%R 10.18653/v1/2021.mwe-1.1
%U https://aclanthology.org/2021.mwe-1.1/
%U https://doi.org/10.18653/v1/2021.mwe-1.1
%P 1

Download as File

Markdown (Informal)

[A Long Hard Look at MWEs in the Age of Language Models](https://aclanthology.org/2021.mwe-1.1/) (Shwartz, MWE 2021)

A Long Hard Look at MWEs in the Age of Language Models (Shwartz, MWE 2021)

ACL

Vered Shwartz. 2021. A Long Hard Look at MWEs in the Age of Language Models. In Proceedings of the 17th Workshop on Multiword Expressions (MWE 2021), page 1, Online. Association for Computational Linguistics.