The Steep Road to Happily Ever after: an Analysis of Current Visual Storytelling Models

Yatri Modi, Natalie Parde


Abstract
Visual storytelling is an intriguing and complex task that only recently entered the research arena. In this work, we survey relevant work to date, and conduct a thorough error analysis of three very recent approaches to visual storytelling. We categorize and provide examples of common types of errors, and identify key shortcomings in current work. Finally, we make recommendations for addressing these limitations in the future.
Anthology ID:
W19-1805
Volume:
Proceedings of the Second Workshop on Shortcomings in Vision and Language
Month:
June
Year:
2019
Address:
Minneapolis, Minnesota
Editors:
Raffaella Bernardi, Raquel Fernandez, Spandana Gella, Kushal Kafle, Christopher Kanan, Stefan Lee, Moin Nabi
Venue:
NAACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
47–57
Language:
URL:
https://aclanthology.org/W19-1805
DOI:
10.18653/v1/W19-1805
Bibkey:
Cite (ACL):
Yatri Modi and Natalie Parde. 2019. The Steep Road to Happily Ever after: an Analysis of Current Visual Storytelling Models. In Proceedings of the Second Workshop on Shortcomings in Vision and Language, pages 47–57, Minneapolis, Minnesota. Association for Computational Linguistics.
Cite (Informal):
The Steep Road to Happily Ever after: an Analysis of Current Visual Storytelling Models (Modi & Parde, NAACL 2019)
Copy Citation:
PDF:
https://aclanthology.org/W19-1805.pdf
Data
VIST