SemEval-2023 Task 1: Visual Word Sense Disambiguation

Alessandro Raganato, Iacer Calixto, Asahi Ushio, Jose Camacho-Collados, Mohammad Taher Pilehvar


Abstract
This paper presents the Visual Word Sense Disambiguation (Visual-WSD) task. The objective of Visual-WSD is to identify among a set of ten images the one that corresponds to the intended meaning of a given ambiguous word which is accompanied with minimal context. The task provides datasets for three different languages: English, Italian, and Farsi.We received a total of 96 different submissions. Out of these, 40 systems outperformed a strong zero-shot CLIP-based baseline. Participating systems proposed different zero- and few-shot approaches, often involving generative models and data augmentation. More information can be found on the task’s website: \url{https://raganato.github.io/vwsd/}.
Anthology ID:
2023.semeval-1.308
Volume:
Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023)
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Atul Kr. Ojha, A. Seza Doğruöz, Giovanni Da San Martino, Harish Tayyar Madabushi, Ritesh Kumar, Elisa Sartori
Venue:
SemEval
SIG:
SIGLEX
Publisher:
Association for Computational Linguistics
Note:
Pages:
2227–2234
Language:
URL:
https://aclanthology.org/2023.semeval-1.308
DOI:
10.18653/v1/2023.semeval-1.308
Bibkey:
Cite (ACL):
Alessandro Raganato, Iacer Calixto, Asahi Ushio, Jose Camacho-Collados, and Mohammad Taher Pilehvar. 2023. SemEval-2023 Task 1: Visual Word Sense Disambiguation. In Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023), pages 2227–2234, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
SemEval-2023 Task 1: Visual Word Sense Disambiguation (Raganato et al., SemEval 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.semeval-1.308.pdf
Video:
 https://aclanthology.org/2023.semeval-1.308.mp4