<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="bahuleyan-el-asri-2020-diverse">
    <titleInfo>
        <title>Diverse Keyphrase Generation with Neural Unlikelihood Training</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Hareesh</namePart>
        <namePart type="family">Bahuleyan</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Layla</namePart>
        <namePart type="family">El Asri</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2020-12</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the 28th International Conference on Computational Linguistics</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Donia</namePart>
            <namePart type="family">Scott</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Nuria</namePart>
            <namePart type="family">Bel</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Chengqing</namePart>
            <namePart type="family">Zong</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>International Committee on Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Barcelona, Spain (Online)</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>In this paper, we study sequence-to-sequence (S2S) keyphrase generation models from the perspective of diversity. Recent advances in neural natural language generation have made possible remarkable progress on the task of keyphrase generation, demonstrated through improvements on quality metrics such as F1-score. However, the importance of diversity in keyphrase generation has been largely ignored. We first analyze the extent of information redundancy present in the outputs generated by a baseline model trained using maximum likelihood estimation (MLE). Our findings show that repetition of keyphrases is a major issue with MLE training. To alleviate this issue, we adopt neural unlikelihood (UL) objective for training the S2S model. Our version of UL training operates at (1) the target token level to discourage the generation of repeating tokens; (2) the copy token level to avoid copying repetitive tokens from the source text. Further, to encourage better model planning during the decoding process, we incorporate K-step ahead token prediction objective that computes both MLE and UL losses on future tokens as well. Through extensive experiments on datasets from three different domains we demonstrate that the proposed approach attains considerably large diversity gains, while maintaining competitive output quality.</abstract>
    <identifier type="citekey">bahuleyan-el-asri-2020-diverse</identifier>
    <identifier type="doi">10.18653/v1/2020.coling-main.462</identifier>
    <location>
        <url>https://aclanthology.org/2020.coling-main.462</url>
    </location>
    <part>
        <date>2020-12</date>
        <extent unit="page">
            <start>5271</start>
            <end>5287</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T Diverse Keyphrase Generation with Neural Unlikelihood Training
%A Bahuleyan, Hareesh
%A El Asri, Layla
%Y Scott, Donia
%Y Bel, Nuria
%Y Zong, Chengqing
%S Proceedings of the 28th International Conference on Computational Linguistics
%D 2020
%8 December
%I International Committee on Computational Linguistics
%C Barcelona, Spain (Online)
%F bahuleyan-el-asri-2020-diverse
%X In this paper, we study sequence-to-sequence (S2S) keyphrase generation models from the perspective of diversity. Recent advances in neural natural language generation have made possible remarkable progress on the task of keyphrase generation, demonstrated through improvements on quality metrics such as F1-score. However, the importance of diversity in keyphrase generation has been largely ignored. We first analyze the extent of information redundancy present in the outputs generated by a baseline model trained using maximum likelihood estimation (MLE). Our findings show that repetition of keyphrases is a major issue with MLE training. To alleviate this issue, we adopt neural unlikelihood (UL) objective for training the S2S model. Our version of UL training operates at (1) the target token level to discourage the generation of repeating tokens; (2) the copy token level to avoid copying repetitive tokens from the source text. Further, to encourage better model planning during the decoding process, we incorporate K-step ahead token prediction objective that computes both MLE and UL losses on future tokens as well. Through extensive experiments on datasets from three different domains we demonstrate that the proposed approach attains considerably large diversity gains, while maintaining competitive output quality.
%R 10.18653/v1/2020.coling-main.462
%U https://aclanthology.org/2020.coling-main.462
%U https://doi.org/10.18653/v1/2020.coling-main.462
%P 5271-5287

Markdown (Informal)

[Diverse Keyphrase Generation with Neural Unlikelihood Training](https://aclanthology.org/2020.coling-main.462) (Bahuleyan & El Asri, COLING 2020)

• Diverse Keyphrase Generation with Neural Unlikelihood Training (Bahuleyan & El Asri, COLING 2020)

ACL

• Hareesh Bahuleyan and Layla El Asri. 2020. Diverse Keyphrase Generation with Neural Unlikelihood Training. In Proceedings of the 28th International Conference on Computational Linguistics, pages 5271–5287, Barcelona, Spain (Online). International Committee on Computational Linguistics.