CITE: A Corpus of Image-Text Discourse Relations

Malihe Alikhani, Sreyasi Nag Chowdhury, Gerard de Melo, Matthew Stone


Abstract
This paper presents a novel crowd-sourced resource for multimodal discourse: our resource characterizes inferences in image-text contexts in the domain of cooking recipes in the form of coherence relations. Like previous corpora annotating discourse structure between text arguments, such as the Penn Discourse Treebank, our new corpus aids in establishing a better understanding of natural communication and common-sense reasoning, while our findings have implications for a wide range of applications, such as understanding and generation of multimodal documents.
Anthology ID:
N19-1056
Volume:
Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers)
Month:
June
Year:
2019
Address:
Minneapolis, Minnesota
Editors:
Jill Burstein, Christy Doran, Thamar Solorio
Venue:
NAACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
570–575
Language:
URL:
https://aclanthology.org/N19-1056
DOI:
10.18653/v1/N19-1056
Bibkey:
Cite (ACL):
Malihe Alikhani, Sreyasi Nag Chowdhury, Gerard de Melo, and Matthew Stone. 2019. CITE: A Corpus of Image-Text Discourse Relations. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), pages 570–575, Minneapolis, Minnesota. Association for Computational Linguistics.
Cite (Informal):
CITE: A Corpus of Image-Text Discourse Relations (Alikhani et al., NAACL 2019)
Copy Citation:
PDF:
https://aclanthology.org/N19-1056.pdf
Video:
 https://aclanthology.org/N19-1056.mp4
Code
 malihealikhani/CITE
Data
CITERecipeQA