DRCoVe: An Augmented Word Representation Approach using Distributional and Relational Context

Md. Aslam Parwez, Muhammad Abulaish, Mohd Fazil


Abstract
Word representation using the distributional information of words from a sizeable corpus is considered efficacious in many natural language processing and text mining applications. However, distributional representation of a word is unable to capture distant relational knowledge, representing the relational semantics. In this paper, we propose a novel word representation approach using distributional and relational contexts, DRCoVe, which augments the distributional representation of a word using the relational semantics extracted as syntactic and semantic association among entities from the underlying corpus. Unlike existing approaches that use external knowledge bases representing the relational semantics for enhanced word representation, DRCoVe uses typed dependencies (aka syntactic dependencies) to extract relational knowledge from the underlying corpus. The proposed approach is applied over a biomedical text corpus to learn word representation and compared with GloVe, which is one of the most popular word embedding approaches. The evaluation results on various benchmark datasets for word similarity and word categorization tasks demonstrate the effectiveness of DRCoVe over the GloVe.
Anthology ID:
2019.icon-1.26
Volume:
Proceedings of the 16th International Conference on Natural Language Processing
Month:
December
Year:
2019
Address:
International Institute of Information Technology, Hyderabad, India
Editors:
Dipti Misra Sharma, Pushpak Bhattacharya
Venue:
ICON
SIG:
Publisher:
NLP Association of India
Note:
Pages:
220–229
Language:
URL:
https://aclanthology.org/2019.icon-1.26
DOI:
Bibkey:
Cite (ACL):
Md. Aslam Parwez, Muhammad Abulaish, and Mohd Fazil. 2019. DRCoVe: An Augmented Word Representation Approach using Distributional and Relational Context. In Proceedings of the 16th International Conference on Natural Language Processing, pages 220–229, International Institute of Information Technology, Hyderabad, India. NLP Association of India.
Cite (Informal):
DRCoVe: An Augmented Word Representation Approach using Distributional and Relational Context (Parwez et al., ICON 2019)
Copy Citation:
PDF:
https://aclanthology.org/2019.icon-1.26.pdf