<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="sakaguchi-etal-2016-reassessing">
    <titleInfo>
        <title>Reassessing the Goals of Grammatical Error Correction: Fluency Instead of Grammaticality</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Keisuke</namePart>
        <namePart type="family">Sakaguchi</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Courtney</namePart>
        <namePart type="family">Napoles</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Matt</namePart>
        <namePart type="family">Post</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Joel</namePart>
        <namePart type="family">Tetreault</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2016</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <genre authority="bibutilsgt">journal article</genre>
    <relatedItem type="host">
        <titleInfo>
            <title>Transactions of the Association for Computational Linguistics</title>
        </titleInfo>
        <originInfo>
            <issuance>continuing</issuance>
            <publisher>MIT Press</publisher>
            <place>
                <placeTerm type="text">Cambridge, MA</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">periodical</genre>
        <genre authority="bibutilsgt">academic journal</genre>
    </relatedItem>
    <abstract>The field of grammatical error correction (GEC) has grown substantially in recent years, with research directed at both evaluation metrics and improved system performance against those metrics. One unvisited assumption, however, is the reliance of GEC evaluation on error-coded corpora, which contain specific labeled corrections. We examine current practices and show that GEC’s reliance on such corpora unnaturally constrains annotation and automatic evaluation, resulting in (a) sentences that do not sound acceptable to native speakers and (b) system rankings that do not correlate with human judgments. In light of this, we propose an alternate approach that jettisons costly error coding in favor of unannotated, whole-sentence rewrites. We compare the performance of existing metrics over different gold-standard annotations, and show that automatic evaluation with our new annotation scheme has very strong correlation with expert rankings (ρ = 0.82). As a result, we advocate for a fundamental and necessary shift in the goal of GEC, from correcting small, labeled error types, to producing text that has native fluency.</abstract>
    <identifier type="citekey">sakaguchi-etal-2016-reassessing</identifier>
    <identifier type="doi">10.1162/tacl_a_00091</identifier>
    <location>
        <url>https://aclanthology.org/Q16-1013</url>
    </location>
    <part>
        <date>2016</date>
        <detail type="volume"><number>4</number></detail>
        <extent unit="page">
            <start>169</start>
            <end>182</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Journal Article
%T Reassessing the Goals of Grammatical Error Correction: Fluency Instead of Grammaticality
%A Sakaguchi, Keisuke
%A Napoles, Courtney
%A Post, Matt
%A Tetreault, Joel
%J Transactions of the Association for Computational Linguistics
%D 2016
%V 4
%I MIT Press
%C Cambridge, MA
%F sakaguchi-etal-2016-reassessing
%X The field of grammatical error correction (GEC) has grown substantially in recent years, with research directed at both evaluation metrics and improved system performance against those metrics. One unvisited assumption, however, is the reliance of GEC evaluation on error-coded corpora, which contain specific labeled corrections. We examine current practices and show that GEC’s reliance on such corpora unnaturally constrains annotation and automatic evaluation, resulting in (a) sentences that do not sound acceptable to native speakers and (b) system rankings that do not correlate with human judgments. In light of this, we propose an alternate approach that jettisons costly error coding in favor of unannotated, whole-sentence rewrites. We compare the performance of existing metrics over different gold-standard annotations, and show that automatic evaluation with our new annotation scheme has very strong correlation with expert rankings (ρ = 0.82). As a result, we advocate for a fundamental and necessary shift in the goal of GEC, from correcting small, labeled error types, to producing text that has native fluency.
%R 10.1162/tacl_a_00091
%U https://aclanthology.org/Q16-1013
%U https://doi.org/10.1162/tacl_a_00091
%P 169-182

Markdown (Informal)

[Reassessing the Goals of Grammatical Error Correction: Fluency Instead of Grammaticality](https://aclanthology.org/Q16-1013) (Sakaguchi et al., TACL 2016)

• Reassessing the Goals of Grammatical Error Correction: Fluency Instead of Grammaticality (Sakaguchi et al., TACL 2016)

ACL

• Keisuke Sakaguchi, Courtney Napoles, Matt Post, and Joel Tetreault. 2016. Reassessing the Goals of Grammatical Error Correction: Fluency Instead of Grammaticality. Transactions of the Association for Computational Linguistics, 4:169–182.