<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="mahamood-2024-reprohum">
    <titleInfo>
        <title>ReproHum #0124-03: Reproducing Human Evaluations of end-to-end approaches for Referring Expression Generation</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Saad</namePart>
        <namePart type="family">Mahamood</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2024-05</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the Fourth Workshop on Human Evaluation of NLP Systems (HumEval) @ LREC-COLING 2024</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Simone</namePart>
            <namePart type="family">Balloccu</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Anya</namePart>
            <namePart type="family">Belz</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Rudali</namePart>
            <namePart type="family">Huidrom</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Ehud</namePart>
            <namePart type="family">Reiter</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Joao</namePart>
            <namePart type="family">Sedoc</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Craig</namePart>
            <namePart type="family">Thomson</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>ELRA and ICCL</publisher>
            <place>
                <placeTerm type="text">Torino, Italia</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>In this paper we describe our attempt to reproduce a single human evaluation quality criterion of the human evaluation that was in conducted in the paper “NeuralREG: An end-to-end approach to referring expression generation”. In particular, this paper describes the approach and challenges involved in reproducing the human evaluation as done by the original authors of the paper, the results obtained, and what insights we have gained from attempting this particular reproduction. Insights that we hope will enable refinements to both how human evaluations are documented by author(s) and enable better reproductions of NLP experiments in the future.</abstract>
    <identifier type="citekey">mahamood-2024-reprohum</identifier>
    <location>
        <url>https://aclanthology.org/2024.humeval-1.22</url>
    </location>
    <part>
        <date>2024-05</date>
        <extent unit="page">
            <start>250</start>
            <end>254</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T ReproHum #0124-03: Reproducing Human Evaluations of end-to-end approaches for Referring Expression Generation
%A Mahamood, Saad
%Y Balloccu, Simone
%Y Belz, Anya
%Y Huidrom, Rudali
%Y Reiter, Ehud
%Y Sedoc, Joao
%Y Thomson, Craig
%S Proceedings of the Fourth Workshop on Human Evaluation of NLP Systems (HumEval) @ LREC-COLING 2024
%D 2024
%8 May
%I ELRA and ICCL
%C Torino, Italia
%F mahamood-2024-reprohum
%X In this paper we describe our attempt to reproduce a single human evaluation quality criterion of the human evaluation that was in conducted in the paper “NeuralREG: An end-to-end approach to referring expression generation”. In particular, this paper describes the approach and challenges involved in reproducing the human evaluation as done by the original authors of the paper, the results obtained, and what insights we have gained from attempting this particular reproduction. Insights that we hope will enable refinements to both how human evaluations are documented by author(s) and enable better reproductions of NLP experiments in the future.
%U https://aclanthology.org/2024.humeval-1.22
%P 250-254

Markdown (Informal)

[ReproHum #0124-03: Reproducing Human Evaluations of end-to-end approaches for Referring Expression Generation](https://aclanthology.org/2024.humeval-1.22) (Mahamood, HumEval-WS 2024)

• ReproHum #0124-03: Reproducing Human Evaluations of end-to-end approaches for Referring Expression Generation (Mahamood, HumEval-WS 2024)

ACL

• Saad Mahamood. 2024. ReproHum #0124-03: Reproducing Human Evaluations of end-to-end approaches for Referring Expression Generation. In Proceedings of the Fourth Workshop on Human Evaluation of NLP Systems (HumEval) @ LREC-COLING 2024, pages 250–254, Torino, Italia. ELRA and ICCL.