Deep Learning Architecture for Complex Word Identification

Dirk De Hertog, Anaïs Tack


Abstract
We describe a system for the CWI-task that includes information on 5 aspects of the (complex) lexical item, namely distributional information of the item itself, morphological structure, psychological measures, corpus-counts and topical information. We constructed a deep learning architecture that combines those features and apply it to the probabilistic and binary classification task for all English sets and Spanish. We achieved reasonable performance on all sets with best performances seen on the probabilistic task, particularly on the English news set (MAE 0.054 and F1-score of 0.872). An analysis of the results shows that reasonable performance can be achieved with a single architecture without any domain-specific tweaking of the parameter settings and that distributional features capture almost all of the information also found in hand-crafted features.
Anthology ID:
W18-0539
Volume:
Proceedings of the Thirteenth Workshop on Innovative Use of NLP for Building Educational Applications
Month:
June
Year:
2018
Address:
New Orleans, Louisiana
Editors:
Joel Tetreault, Jill Burstein, Ekaterina Kochmar, Claudia Leacock, Helen Yannakoudakis
Venue:
BEA
SIG:
SIGEDU
Publisher:
Association for Computational Linguistics
Note:
Pages:
328–334
Language:
URL:
https://aclanthology.org/W18-0539
DOI:
10.18653/v1/W18-0539
Bibkey:
Cite (ACL):
Dirk De Hertog and Anaïs Tack. 2018. Deep Learning Architecture for Complex Word Identification. In Proceedings of the Thirteenth Workshop on Innovative Use of NLP for Building Educational Applications, pages 328–334, New Orleans, Louisiana. Association for Computational Linguistics.
Cite (Informal):
Deep Learning Architecture for Complex Word Identification (De Hertog & Tack, BEA 2018)
Copy Citation:
PDF:
https://aclanthology.org/W18-0539.pdf