Corpora for Learning the Mutual Relationship between Semantic Relatedness and Textual Entailment

Ngoc Phuoc An Vo, Octavian Popescu


Abstract
In this paper we present the creation of a corpora annotated with both semantic relatedness (SR) scores and textual entailment (TE) judgments. In building this corpus we aimed at discovering, if any, the relationship between these two tasks for the mutual benefit of resolving one of them by relying on the insights gained from the other. We considered a corpora already annotated with TE judgments and we proceed to the manual annotation with SR scores. The RTE 1-4 corpora used in the PASCAL competition fit our need. The annotators worked independently of one each other and they did not have access to the TE judgment during annotation. The intuition that the two annotations are correlated received major support from this experiment and this finding led to a system that uses this information to revise the initial estimates of SR scores. As semantic relatedness is one of the most general and difficult task in natural language processing we expect that future systems will combine different sources of information in order to solve it. Our work suggests that textual entailment plays a quantifiable role in addressing it.
Anthology ID:
L16-1539
Volume:
Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16)
Month:
May
Year:
2016
Address:
Portorož, Slovenia
Editors:
Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Sara Goggi, Marko Grobelnik, Bente Maegaard, Joseph Mariani, Helene Mazo, Asuncion Moreno, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
3379–3386
Language:
URL:
https://aclanthology.org/L16-1539
DOI:
Bibkey:
Cite (ACL):
Ngoc Phuoc An Vo and Octavian Popescu. 2016. Corpora for Learning the Mutual Relationship between Semantic Relatedness and Textual Entailment. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16), pages 3379–3386, Portorož, Slovenia. European Language Resources Association (ELRA).
Cite (Informal):
Corpora for Learning the Mutual Relationship between Semantic Relatedness and Textual Entailment (Vo & Popescu, LREC 2016)
Copy Citation:
PDF:
https://aclanthology.org/L16-1539.pdf