<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="hong-etal-2020-diverse">
    <titleInfo>
        <title>Diverse and Relevant Visual Storytelling with Scene Graph Embeddings</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Xudong</namePart>
        <namePart type="family">Hong</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Rakshith</namePart>
        <namePart type="family">Shetty</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Asad</namePart>
        <namePart type="family">Sayeed</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Khushboo</namePart>
        <namePart type="family">Mehra</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Vera</namePart>
        <namePart type="family">Demberg</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Bernt</namePart>
        <namePart type="family">Schiele</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2020-11</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the 24th Conference on Computational Natural Language Learning</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Raquel</namePart>
            <namePart type="family">Fernández</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Tal</namePart>
            <namePart type="family">Linzen</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Online</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>A problem in automatically generated stories for image sequences is that they use overly generic vocabulary and phrase structure and fail to match the distributional characteristics of human-generated text. We address this problem by introducing explicit representations for objects and their relations by extracting scene graphs from the images. Utilizing an embedding of this scene graph enables our model to more explicitly reason over objects and their relations during story generation, compared to the global features from an object classifier used in previous work. We apply metrics that account for the diversity of words and phrases of generated stories as well as for reference to narratively-salient image features and show that our approach outperforms previous systems. Our experiments also indicate that our models obtain competitive results on reference-based metrics.</abstract>
    <identifier type="citekey">hong-etal-2020-diverse</identifier>
    <identifier type="doi">10.18653/v1/2020.conll-1.34</identifier>
    <location>
        <url>https://aclanthology.org/2020.conll-1.34</url>
    </location>
    <part>
        <date>2020-11</date>
        <extent unit="page">
            <start>420</start>
            <end>430</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T Diverse and Relevant Visual Storytelling with Scene Graph Embeddings
%A Hong, Xudong
%A Shetty, Rakshith
%A Sayeed, Asad
%A Mehra, Khushboo
%A Demberg, Vera
%A Schiele, Bernt
%Y Fernández, Raquel
%Y Linzen, Tal
%S Proceedings of the 24th Conference on Computational Natural Language Learning
%D 2020
%8 November
%I Association for Computational Linguistics
%C Online
%F hong-etal-2020-diverse
%X A problem in automatically generated stories for image sequences is that they use overly generic vocabulary and phrase structure and fail to match the distributional characteristics of human-generated text. We address this problem by introducing explicit representations for objects and their relations by extracting scene graphs from the images. Utilizing an embedding of this scene graph enables our model to more explicitly reason over objects and their relations during story generation, compared to the global features from an object classifier used in previous work. We apply metrics that account for the diversity of words and phrases of generated stories as well as for reference to narratively-salient image features and show that our approach outperforms previous systems. Our experiments also indicate that our models obtain competitive results on reference-based metrics.
%R 10.18653/v1/2020.conll-1.34
%U https://aclanthology.org/2020.conll-1.34
%U https://doi.org/10.18653/v1/2020.conll-1.34
%P 420-430

Markdown (Informal)

[Diverse and Relevant Visual Storytelling with Scene Graph Embeddings](https://aclanthology.org/2020.conll-1.34) (Hong et al., CoNLL 2020)

• Diverse and Relevant Visual Storytelling with Scene Graph Embeddings (Hong et al., CoNLL 2020)

ACL

• Xudong Hong, Rakshith Shetty, Asad Sayeed, Khushboo Mehra, Vera Demberg, and Bernt Schiele. 2020. Diverse and Relevant Visual Storytelling with Scene Graph Embeddings. In Proceedings of the 24th Conference on Computational Natural Language Learning, pages 420–430, Online. Association for Computational Linguistics.