Paparazzi: A Deep Dive into the Capabilities of Language and Vision Models for Grounding Viewpoint Descriptions

Henrik Voigt, Jan Hombeck, Monique Meuschke, Kai Lawonn, Sina Zarrieß


Abstract
Existing language and vision models achieve impressive performance in image-text understanding. Yet, it is an open question to what extent they can be used for language understanding in 3D environments and whether they implicitly acquire 3D object knowledge, e.g. about different views of an object. In this paper, we investigate whether a state-of-the-art language and vision model, CLIP, is able to ground perspective descriptions of a 3D object and identify canonical views of common objects based on text queries. We present an evaluation framework that uses a circling camera around a 3D object to generate images from different viewpoints and evaluate them in terms of their similarity to natural language descriptions. We find that a pre-trained CLIP model performs poorly on most canonical views and that fine-tuning using hard negative sampling and random contrasting yields good results even under conditions with little available training data.
Anthology ID:
2023.findings-eacl.62
Volume:
Findings of the Association for Computational Linguistics: EACL 2023
Month:
May
Year:
2023
Address:
Dubrovnik, Croatia
Editors:
Andreas Vlachos, Isabelle Augenstein
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
828–843
Language:
URL:
https://aclanthology.org/2023.findings-eacl.62
DOI:
10.18653/v1/2023.findings-eacl.62
Bibkey:
Cite (ACL):
Henrik Voigt, Jan Hombeck, Monique Meuschke, Kai Lawonn, and Sina Zarrieß. 2023. Paparazzi: A Deep Dive into the Capabilities of Language and Vision Models for Grounding Viewpoint Descriptions. In Findings of the Association for Computational Linguistics: EACL 2023, pages 828–843, Dubrovnik, Croatia. Association for Computational Linguistics.
Cite (Informal):
Paparazzi: A Deep Dive into the Capabilities of Language and Vision Models for Grounding Viewpoint Descriptions (Voigt et al., Findings 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.findings-eacl.62.pdf
Video:
 https://aclanthology.org/2023.findings-eacl.62.mp4