Czech Dataset for Semantic Similarity and Relatedness

Miloslav Konopík, Ondřej Pražák, David Steinberger


Abstract
This paper introduces a Czech dataset for semantic similarity and semantic relatedness. The dataset contains word pairs with hand annotated scores that indicate the semantic similarity and semantic relatedness of the words. The dataset contains 953 word pairs compiled from 9 different sources. It contains words and their contexts taken from real text corpora including extra examples when the words are ambiguous. The dataset is annotated by 5 independent annotators. The average Spearman correlation coefficient of the annotation agreement is r = 0.81. We provide reference evaluation experiments with several methods for computing semantic similarity and relatedness.
Anthology ID:
R17-1053
Volume:
Proceedings of the International Conference Recent Advances in Natural Language Processing, RANLP 2017
Month:
September
Year:
2017
Address:
Varna, Bulgaria
Editors:
Ruslan Mitkov, Galia Angelova
Venue:
RANLP
SIG:
Publisher:
INCOMA Ltd.
Note:
Pages:
401–406
Language:
URL:
https://doi.org/10.26615/978-954-452-049-6_053
DOI:
10.26615/978-954-452-049-6_053
Bibkey:
Cite (ACL):
Miloslav Konopík, Ondřej Pražák, and David Steinberger. 2017. Czech Dataset for Semantic Similarity and Relatedness. In Proceedings of the International Conference Recent Advances in Natural Language Processing, RANLP 2017, pages 401–406, Varna, Bulgaria. INCOMA Ltd..
Cite (Informal):
Czech Dataset for Semantic Similarity and Relatedness (Konopík et al., RANLP 2017)
Copy Citation:
PDF:
https://doi.org/10.26615/978-954-452-049-6_053