<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="lappin-bernardy-2022-neural">
    <titleInfo>
        <title>A Neural Model for Compositional Word Embeddings and Sentence Processing</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Shalom</namePart>
        <namePart type="family">Lappin</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Jean-Philippe</namePart>
        <namePart type="family">Bernardy</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2022-05</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the Workshop on Cognitive Modeling and Computational Linguistics</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Emmanuele</namePart>
            <namePart type="family">Chersoni</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Nora</namePart>
            <namePart type="family">Hollenstein</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Cassandra</namePart>
            <namePart type="family">Jacobs</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Yohei</namePart>
            <namePart type="family">Oseki</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Laurent</namePart>
            <namePart type="family">Prévot</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Enrico</namePart>
            <namePart type="family">Santus</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Dublin, Ireland</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>We propose a new neural model for word embeddings, which uses Unitary Matrices as the primary device for encoding lexical information. It uses simple matrix multiplication to derive matrices for large units, yielding a sentence processing model that is strictly compositional, does not lose information over time steps, and is transparent, in the sense that word embeddings can be analysed regardless of context. This model does not employ activation functions, and so the network is fully accessible to analysis by the methods of linear algebra at each point in its operation on an input sequence. We test it in two NLP agreement tasks and obtain rule like perfect accuracy, with greater stability than current state-of-the-art systems. Our proposed model goes some way towards offering a class of computationally powerful deep learning systems that can be fully understood and compared to human cognitive processes for natural language learning and representation.</abstract>
    <identifier type="citekey">lappin-bernardy-2022-neural</identifier>
    <identifier type="doi">10.18653/v1/2022.cmcl-1.2</identifier>
    <location>
        <url>https://aclanthology.org/2022.cmcl-1.2</url>
    </location>
    <part>
        <date>2022-05</date>
        <extent unit="page">
            <start>12</start>
            <end>22</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T A Neural Model for Compositional Word Embeddings and Sentence Processing
%A Lappin, Shalom
%A Bernardy, Jean-Philippe
%Y Chersoni, Emmanuele
%Y Hollenstein, Nora
%Y Jacobs, Cassandra
%Y Oseki, Yohei
%Y Prévot, Laurent
%Y Santus, Enrico
%S Proceedings of the Workshop on Cognitive Modeling and Computational Linguistics
%D 2022
%8 May
%I Association for Computational Linguistics
%C Dublin, Ireland
%F lappin-bernardy-2022-neural
%X We propose a new neural model for word embeddings, which uses Unitary Matrices as the primary device for encoding lexical information. It uses simple matrix multiplication to derive matrices for large units, yielding a sentence processing model that is strictly compositional, does not lose information over time steps, and is transparent, in the sense that word embeddings can be analysed regardless of context. This model does not employ activation functions, and so the network is fully accessible to analysis by the methods of linear algebra at each point in its operation on an input sequence. We test it in two NLP agreement tasks and obtain rule like perfect accuracy, with greater stability than current state-of-the-art systems. Our proposed model goes some way towards offering a class of computationally powerful deep learning systems that can be fully understood and compared to human cognitive processes for natural language learning and representation.
%R 10.18653/v1/2022.cmcl-1.2
%U https://aclanthology.org/2022.cmcl-1.2
%U https://doi.org/10.18653/v1/2022.cmcl-1.2
%P 12-22

Markdown (Informal)

[A Neural Model for Compositional Word Embeddings and Sentence Processing](https://aclanthology.org/2022.cmcl-1.2) (Lappin & Bernardy, CMCL 2022)

• A Neural Model for Compositional Word Embeddings and Sentence Processing (Lappin & Bernardy, CMCL 2022)

ACL

• Shalom Lappin and Jean-Philippe Bernardy. 2022. A Neural Model for Compositional Word Embeddings and Sentence Processing. In Proceedings of the Workshop on Cognitive Modeling and Computational Linguistics, pages 12–22, Dublin, Ireland. Association for Computational Linguistics.