<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="widdows-etal-2021-semantic">
    <titleInfo>
        <title>Should Semantic Vector Composition be Explicit? Can it be Linear?</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Dominic</namePart>
        <namePart type="family">Widdows</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Kristen</namePart>
        <namePart type="family">Howell</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Trevor</namePart>
        <namePart type="family">Cohen</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2021-06</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the 2021 Workshop on Semantic Spaces at the Intersection of NLP, Physics, and Cognitive Science (SemSpace)</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Martha</namePart>
            <namePart type="family">Lewis</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Mehrnoosh</namePart>
            <namePart type="family">Sadrzadeh</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Groningen, The Netherlands</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>Vector representations have become a central element in semantic language modelling, leading to mathematical overlaps with many fields including quantum theory. Compositionality is a core goal for such representations: given representations for ‘wet’ and ‘fish’, how should the concept ‘wet fish’ be represented? This position paper surveys this question from two points of view. The first considers the question of whether an explicit mathematical representation can be successful using only tools from within linear algebra, or whether other mathematical tools are needed. The second considers whether semantic vector composition should be explicitly described mathematically, or whether it can be a model-internal side-effect of training a neural network. A third and newer question is whether a compositional model can be implemented on a quantum computer. Given the fundamentally linear nature of quantum mechanics, we propose that these questions are related, and that this survey may help to highlight candidate operations for future quantum implementation.</abstract>
    <identifier type="citekey">widdows-etal-2021-semantic</identifier>
    <location>
        <url>https://aclanthology.org/2021.semspace-1.8</url>
    </location>
    <part>
        <date>2021-06</date>
        <extent unit="page">
            <start>76</start>
            <end>86</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T Should Semantic Vector Composition be Explicit? Can it be Linear?
%A Widdows, Dominic
%A Howell, Kristen
%A Cohen, Trevor
%Y Lewis, Martha
%Y Sadrzadeh, Mehrnoosh
%S Proceedings of the 2021 Workshop on Semantic Spaces at the Intersection of NLP, Physics, and Cognitive Science (SemSpace)
%D 2021
%8 June
%I Association for Computational Linguistics
%C Groningen, The Netherlands
%F widdows-etal-2021-semantic
%X Vector representations have become a central element in semantic language modelling, leading to mathematical overlaps with many fields including quantum theory. Compositionality is a core goal for such representations: given representations for ‘wet’ and ‘fish’, how should the concept ‘wet fish’ be represented? This position paper surveys this question from two points of view. The first considers the question of whether an explicit mathematical representation can be successful using only tools from within linear algebra, or whether other mathematical tools are needed. The second considers whether semantic vector composition should be explicitly described mathematically, or whether it can be a model-internal side-effect of training a neural network. A third and newer question is whether a compositional model can be implemented on a quantum computer. Given the fundamentally linear nature of quantum mechanics, we propose that these questions are related, and that this survey may help to highlight candidate operations for future quantum implementation.
%U https://aclanthology.org/2021.semspace-1.8
%P 76-86

Markdown (Informal)

[Should Semantic Vector Composition be Explicit? Can it be Linear?](https://aclanthology.org/2021.semspace-1.8) (Widdows et al., SemSpace 2021)

• Should Semantic Vector Composition be Explicit? Can it be Linear? (Widdows et al., SemSpace 2021)

ACL

• Dominic Widdows, Kristen Howell, and Trevor Cohen. 2021. Should Semantic Vector Composition be Explicit? Can it be Linear?. In Proceedings of the 2021 Workshop on Semantic Spaces at the Intersection of NLP, Physics, and Cognitive Science (SemSpace), pages 76–86, Groningen, The Netherlands. Association for Computational Linguistics.