<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="peyrard-eckle-kohler-2017-principled">
    <titleInfo>
        <title>A Principled Framework for Evaluating Summarizers: Comparing Models of Summary Quality against Human Judgments</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Maxime</namePart>
        <namePart type="family">Peyrard</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Judith</namePart>
        <namePart type="family">Eckle-Kohler</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2017-07</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Regina</namePart>
            <namePart type="family">Barzilay</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Min-Yen</namePart>
            <namePart type="family">Kan</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Vancouver, Canada</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>We present a new framework for evaluating extractive summarizers, which is based on a principled representation as optimization problem. We prove that every extractive summarizer can be decomposed into an objective function and an optimization technique. We perform a comparative analysis and evaluation of several objective functions embedded in well-known summarizers regarding their correlation with human judgments. Our comparison of these correlations across two datasets yields surprising insights into the role and performance of objective functions in the different summarizers.</abstract>
    <identifier type="citekey">peyrard-eckle-kohler-2017-principled</identifier>
    <identifier type="doi">10.18653/v1/P17-2005</identifier>
    <location>
        <url>https://aclanthology.org/P17-2005</url>
    </location>
    <part>
        <date>2017-07</date>
        <extent unit="page">
            <start>26</start>
            <end>31</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T A Principled Framework for Evaluating Summarizers: Comparing Models of Summary Quality against Human Judgments
%A Peyrard, Maxime
%A Eckle-Kohler, Judith
%Y Barzilay, Regina
%Y Kan, Min-Yen
%S Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)
%D 2017
%8 July
%I Association for Computational Linguistics
%C Vancouver, Canada
%F peyrard-eckle-kohler-2017-principled
%X We present a new framework for evaluating extractive summarizers, which is based on a principled representation as optimization problem. We prove that every extractive summarizer can be decomposed into an objective function and an optimization technique. We perform a comparative analysis and evaluation of several objective functions embedded in well-known summarizers regarding their correlation with human judgments. Our comparison of these correlations across two datasets yields surprising insights into the role and performance of objective functions in the different summarizers.
%R 10.18653/v1/P17-2005
%U https://aclanthology.org/P17-2005
%U https://doi.org/10.18653/v1/P17-2005
%P 26-31

Markdown (Informal)

[A Principled Framework for Evaluating Summarizers: Comparing Models of Summary Quality against Human Judgments](https://aclanthology.org/P17-2005) (Peyrard & Eckle-Kohler, ACL 2017)

• A Principled Framework for Evaluating Summarizers: Comparing Models of Summary Quality against Human Judgments (Peyrard & Eckle-Kohler, ACL 2017)

ACL

• Maxime Peyrard and Judith Eckle-Kohler. 2017. A Principled Framework for Evaluating Summarizers: Comparing Models of Summary Quality against Human Judgments. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pages 26–31, Vancouver, Canada. Association for Computational Linguistics.