<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="ilinykh-etal-2018-task">
    <titleInfo>
        <title>The Task Matters: Comparing Image Captioning and Task-Based Dialogical Image Description</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Nikolai</namePart>
        <namePart type="family">Ilinykh</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Sina</namePart>
        <namePart type="family">Zarrieß</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">David</namePart>
        <namePart type="family">Schlangen</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2018-11</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the 11th International Conference on Natural Language Generation</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Emiel</namePart>
            <namePart type="family">Krahmer</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Albert</namePart>
            <namePart type="family">Gatt</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Martijn</namePart>
            <namePart type="family">Goudbeek</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Tilburg University, The Netherlands</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>Image captioning models are typically trained on data that is collected from people who are asked to describe an image, without being given any further task context. As we argue here, this context independence is likely to cause problems for transferring to task settings in which image description is bound by task demands. We demonstrate that careful design of data collection is required to obtain image descriptions which are contextually bounded to a particular meta-level task. As a task, we use MeetUp!, a text-based communication game where two players have the goal of finding each other in a visual environment. To reach this goal, the players need to describe images representing their current location. We analyse a dataset from this domain and show that the nature of image descriptions found in MeetUp! is diverse, dynamic and rich with phenomena that are not present in descriptions obtained through a simple image captioning task, which we ran for comparison.</abstract>
    <identifier type="citekey">ilinykh-etal-2018-task</identifier>
    <identifier type="doi">10.18653/v1/W18-6547</identifier>
    <location>
        <url>https://aclanthology.org/W18-6547</url>
    </location>
    <part>
        <date>2018-11</date>
        <extent unit="page">
            <start>397</start>
            <end>402</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T The Task Matters: Comparing Image Captioning and Task-Based Dialogical Image Description
%A Ilinykh, Nikolai
%A Zarrieß, Sina
%A Schlangen, David
%Y Krahmer, Emiel
%Y Gatt, Albert
%Y Goudbeek, Martijn
%S Proceedings of the 11th International Conference on Natural Language Generation
%D 2018
%8 November
%I Association for Computational Linguistics
%C Tilburg University, The Netherlands
%F ilinykh-etal-2018-task
%X Image captioning models are typically trained on data that is collected from people who are asked to describe an image, without being given any further task context. As we argue here, this context independence is likely to cause problems for transferring to task settings in which image description is bound by task demands. We demonstrate that careful design of data collection is required to obtain image descriptions which are contextually bounded to a particular meta-level task. As a task, we use MeetUp!, a text-based communication game where two players have the goal of finding each other in a visual environment. To reach this goal, the players need to describe images representing their current location. We analyse a dataset from this domain and show that the nature of image descriptions found in MeetUp! is diverse, dynamic and rich with phenomena that are not present in descriptions obtained through a simple image captioning task, which we ran for comparison.
%R 10.18653/v1/W18-6547
%U https://aclanthology.org/W18-6547
%U https://doi.org/10.18653/v1/W18-6547
%P 397-402

Markdown (Informal)

[The Task Matters: Comparing Image Captioning and Task-Based Dialogical Image Description](https://aclanthology.org/W18-6547) (Ilinykh et al., INLG 2018)

• The Task Matters: Comparing Image Captioning and Task-Based Dialogical Image Description (Ilinykh et al., INLG 2018)

ACL

• Nikolai Ilinykh, Sina Zarrieß, and David Schlangen. 2018. The Task Matters: Comparing Image Captioning and Task-Based Dialogical Image Description. In Proceedings of the 11th International Conference on Natural Language Generation, pages 397–402, Tilburg University, The Netherlands. Association for Computational Linguistics.