HSE at TempoWiC: Detecting Meaning Shift in Social Media with Diachronic Language Models

Elizaveta Tukhtina, Kseniia Kashleva, Svetlana Vydrina


Abstract
This paper describes our methods for temporal meaning shift detection, implemented during the TempoWiC shared task. We present two systems: with and without time span data usage. Our approaches are based on the language models fine-tuned for Twitter domain. Both systems outperformed all the competition’s baselines except TimeLMs-SIM. Our best submission achieved the macro-F1 score of 70.09% and took the 7th place. This result was achieved by using diachronic language models from the TimeLMs project.
Anthology ID:
2022.evonlp-1.6
Volume:
Proceedings of the First Workshop on Ever Evolving NLP (EvoNLP)
Month:
December
Year:
2022
Address:
Abu Dhabi, United Arab Emirates (Hybrid)
Editors:
Francesco Barbieri, Jose Camacho-Collados, Bhuwan Dhingra, Luis Espinosa-Anke, Elena Gribovskaya, Angeliki Lazaridou, Daniel Loureiro, Leonardo Neves
Venue:
EvoNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
35–38
Language:
URL:
https://aclanthology.org/2022.evonlp-1.6
DOI:
10.18653/v1/2022.evonlp-1.6
Bibkey:
Cite (ACL):
Elizaveta Tukhtina, Kseniia Kashleva, and Svetlana Vydrina. 2022. HSE at TempoWiC: Detecting Meaning Shift in Social Media with Diachronic Language Models. In Proceedings of the First Workshop on Ever Evolving NLP (EvoNLP), pages 35–38, Abu Dhabi, United Arab Emirates (Hybrid). Association for Computational Linguistics.
Cite (Informal):
HSE at TempoWiC: Detecting Meaning Shift in Social Media with Diachronic Language Models (Tukhtina et al., EvoNLP 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.evonlp-1.6.pdf