<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="mieskes-etal-2019-community">
    <titleInfo>
        <title>Community Perspective on Replicability in Natural Language Processing</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Margot</namePart>
        <namePart type="family">Mieskes</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Karën</namePart>
        <namePart type="family">Fort</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Aurélie</namePart>
        <namePart type="family">Névéol</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Cyril</namePart>
        <namePart type="family">Grouin</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Kevin</namePart>
        <namePart type="family">Cohen</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2019-09</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the International Conference on Recent Advances in Natural Language Processing (RANLP 2019)</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Ruslan</namePart>
            <namePart type="family">Mitkov</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Galia</namePart>
            <namePart type="family">Angelova</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>INCOMA Ltd.</publisher>
            <place>
                <placeTerm type="text">Varna, Bulgaria</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>With recent efforts in drawing attention to the task of replicating and/or reproducing results, for example in the context of COLING 2018 and various LREC workshops, the question arises how the NLP community views the topic of replicability in general. Using a survey, in which we involve members of the NLP community, we investigate how our community perceives this topic, its relevance and options for improvement. Based on over two hundred participants, the survey results confirm earlier observations, that successful reproducibility requires more than having access to code and data. Additionally, the results show that the topic has to be tackled from the authors’, reviewers’ and community’s side.</abstract>
    <identifier type="citekey">mieskes-etal-2019-community</identifier>
    <identifier type="doi">10.26615/978-954-452-056-4_089</identifier>
    <location>
        <url>https://aclanthology.org/R19-1089</url>
    </location>
    <part>
        <date>2019-09</date>
        <extent unit="page">
            <start>768</start>
            <end>775</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T Community Perspective on Replicability in Natural Language Processing
%A Mieskes, Margot
%A Fort, Karën
%A Névéol, Aurélie
%A Grouin, Cyril
%A Cohen, Kevin
%Y Mitkov, Ruslan
%Y Angelova, Galia
%S Proceedings of the International Conference on Recent Advances in Natural Language Processing (RANLP 2019)
%D 2019
%8 September
%I INCOMA Ltd.
%C Varna, Bulgaria
%F mieskes-etal-2019-community
%X With recent efforts in drawing attention to the task of replicating and/or reproducing results, for example in the context of COLING 2018 and various LREC workshops, the question arises how the NLP community views the topic of replicability in general. Using a survey, in which we involve members of the NLP community, we investigate how our community perceives this topic, its relevance and options for improvement. Based on over two hundred participants, the survey results confirm earlier observations, that successful reproducibility requires more than having access to code and data. Additionally, the results show that the topic has to be tackled from the authors’, reviewers’ and community’s side.
%R 10.26615/978-954-452-056-4_089
%U https://aclanthology.org/R19-1089
%U https://doi.org/10.26615/978-954-452-056-4_089
%P 768-775

Markdown (Informal)

[Community Perspective on Replicability in Natural Language Processing](https://aclanthology.org/R19-1089) (Mieskes et al., RANLP 2019)

• Community Perspective on Replicability in Natural Language Processing (Mieskes et al., RANLP 2019)

ACL

• Margot Mieskes, Karën Fort, Aurélie Névéol, Cyril Grouin, and Kevin Cohen. 2019. Community Perspective on Replicability in Natural Language Processing. In Proceedings of the International Conference on Recent Advances in Natural Language Processing (RANLP 2019), pages 768–775, Varna, Bulgaria. INCOMA Ltd..