<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="tang-de-sa-2019-exploiting">
    <titleInfo>
        <title>Exploiting Invertible Decoders for Unsupervised Sentence Representation Learning</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Shuai</namePart>
        <namePart type="family">Tang</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Virginia</namePart>
        <namePart type="given">R</namePart>
        <namePart type="family">de Sa</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2019-07</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Anna</namePart>
            <namePart type="family">Korhonen</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">David</namePart>
            <namePart type="family">Traum</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Lluís</namePart>
            <namePart type="family">Màrquez</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Florence, Italy</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>Encoder-decoder models for unsupervised sentence representation learning using the distributional hypothesis effectively constrain the learnt representation of a sentence to only that needed to reproduce the next sentence. While the decoder is important to constrain the representation, these models tend to discard the decoder after training since only the encoder is needed to map the input sentence into a vector representation. However, parameters learnt in the decoder also contain useful information about the language. In order to utilise the decoder after learning, we present two types of decoding functions whose inverse can be easily derived without expensive inverse calculation. Therefore, the inverse of the decoding function serves as another encoder that produces sentence representations. We show that, with careful design of the decoding functions, the model learns good sentence representations, and the ensemble of the representations produced from the encoder and the inverse of the decoder demonstrate even better generalisation ability and solid transferability.</abstract>
    <identifier type="citekey">tang-de-sa-2019-exploiting</identifier>
    <identifier type="doi">10.18653/v1/P19-1397</identifier>
    <location>
        <url>https://aclanthology.org/P19-1397</url>
    </location>
    <part>
        <date>2019-07</date>
        <extent unit="page">
            <start>4050</start>
            <end>4060</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T Exploiting Invertible Decoders for Unsupervised Sentence Representation Learning
%A Tang, Shuai
%A de Sa, Virginia R.
%Y Korhonen, Anna
%Y Traum, David
%Y Màrquez, Lluís
%S Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics
%D 2019
%8 July
%I Association for Computational Linguistics
%C Florence, Italy
%F tang-de-sa-2019-exploiting
%X Encoder-decoder models for unsupervised sentence representation learning using the distributional hypothesis effectively constrain the learnt representation of a sentence to only that needed to reproduce the next sentence. While the decoder is important to constrain the representation, these models tend to discard the decoder after training since only the encoder is needed to map the input sentence into a vector representation. However, parameters learnt in the decoder also contain useful information about the language. In order to utilise the decoder after learning, we present two types of decoding functions whose inverse can be easily derived without expensive inverse calculation. Therefore, the inverse of the decoding function serves as another encoder that produces sentence representations. We show that, with careful design of the decoding functions, the model learns good sentence representations, and the ensemble of the representations produced from the encoder and the inverse of the decoder demonstrate even better generalisation ability and solid transferability.
%R 10.18653/v1/P19-1397
%U https://aclanthology.org/P19-1397
%U https://doi.org/10.18653/v1/P19-1397
%P 4050-4060

Markdown (Informal)

[Exploiting Invertible Decoders for Unsupervised Sentence Representation Learning](https://aclanthology.org/P19-1397) (Tang & de Sa, ACL 2019)

• Exploiting Invertible Decoders for Unsupervised Sentence Representation Learning (Tang & de Sa, ACL 2019)

ACL

• Shuai Tang and Virginia R. de Sa. 2019. Exploiting Invertible Decoders for Unsupervised Sentence Representation Learning. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 4050–4060, Florence, Italy. Association for Computational Linguistics.