Paraphrase Acquisition from Image Captions

Marcel Gohsen, Matthias Hagen, Martin Potthast, Benno Stein


Abstract
We propose to use image captions from the Web as a previously underutilized resource for paraphrases (i.e., texts with the same “message”) and to create and analyze a corresponding dataset. When an image is reused on the Web, an original caption is often assigned. We hypothesize that different captions for the same image naturally form a set of mutual paraphrases. To demonstrate the suitability of this idea, we analyze captions in the English Wikipedia, where editors frequently relabel the same image for different articles. The paper introduces the underlying mining technology, the resulting Wikipedia-IPC dataset, and compares known paraphrase corpora with respect to their syntactic and semantic paraphrase similarity to our new resource. In this context, we introduce characteristic maps along the two similarity dimensions to identify the style of paraphrases coming from different sources. An annotation study demonstrates the high reliability of the algorithmically determined characteristic maps.
Anthology ID:
2023.eacl-main.243
Volume:
Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics
Month:
May
Year:
2023
Address:
Dubrovnik, Croatia
Editors:
Andreas Vlachos, Isabelle Augenstein
Venue:
EACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
3348–3358
Language:
URL:
https://aclanthology.org/2023.eacl-main.243
DOI:
10.18653/v1/2023.eacl-main.243
Bibkey:
Cite (ACL):
Marcel Gohsen, Matthias Hagen, Martin Potthast, and Benno Stein. 2023. Paraphrase Acquisition from Image Captions. In Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics, pages 3348–3358, Dubrovnik, Croatia. Association for Computational Linguistics.
Cite (Informal):
Paraphrase Acquisition from Image Captions (Gohsen et al., EACL 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.eacl-main.243.pdf
Video:
 https://aclanthology.org/2023.eacl-main.243.mp4