LSCDiscovery: A shared task on semantic change discovery and detection in Spanish

Frank D. Zamora-Reina, Felipe Bravo-Marquez, Dominik Schlechtweg


Abstract
We present the first shared task on semantic change discovery and detection in Spanish. We create the first dataset of Spanish words manually annotated by semantic change using the DURel framewok (Schlechtweg et al., 2018). The task is divided in two phases: 1) graded change discovery, and 2) binary change detection. In addition to introducing a new language for this task, the main novelty with respect to the previous tasks consists in predicting and evaluating changes for all vocabulary words in the corpus. Six teams participated in phase 1 and seven teams in phase 2 of the shared task, and the best system obtained a Spearman rank correlation of 0.735 for phase 1 and an F1 score of 0.735 for phase 2. We describe the systems developed by the competing teams, highlighting the techniques that were particularly useful.
Anthology ID:
2022.lchange-1.16
Volume:
Proceedings of the 3rd Workshop on Computational Approaches to Historical Language Change
Month:
May
Year:
2022
Address:
Dublin, Ireland
Venues:
ACL | LChange
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
149–164
Language:
URL:
https://aclanthology.org/2022.lchange-1.16
DOI:
10.18653/v1/2022.lchange-1.16
Bibkey:
Cite (ACL):
Frank D. Zamora-Reina, Felipe Bravo-Marquez, and Dominik Schlechtweg. 2022. LSCDiscovery: A shared task on semantic change discovery and detection in Spanish. In Proceedings of the 3rd Workshop on Computational Approaches to Historical Language Change, pages 149–164, Dublin, Ireland. Association for Computational Linguistics.
Cite (Informal):
LSCDiscovery: A shared task on semantic change discovery and detection in Spanish (Zamora-Reina et al., LChange 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.lchange-1.16.pdf