CompLex — A New Corpus for Lexical Complexity Prediction from Likert Scale Data

Matthew Shardlow, Michael Cooper, Marcos Zampieri


Abstract
Predicting which words are considered hard to understand for a given target population is a vital step in many NLP applications such astext simplification. This task is commonly referred to as Complex Word Identification (CWI). With a few exceptions, previous studieshave approached the task as a binary classification task in which systems predict a complexity value (complex vs. non-complex) fora set of target words in a text. This choice is motivated by the fact that all CWI datasets compiled so far have been annotated using abinary annotation scheme. Our paper addresses this limitation by presenting the first English dataset for continuous lexical complexityprediction. We use a 5-point Likert scale scheme to annotate complex words in texts from three sources/domains: the Bible, Europarl,and biomedical texts. This resulted in a corpus of 9,476 sentences each annotated by around 7 annotators.
Anthology ID:
2020.readi-1.9
Original:
2020.readi-1.9v1
Version 2:
2020.readi-1.9v2
Volume:
Proceedings of the 1st Workshop on Tools and Resources to Empower People with REAding DIfficulties (READI)
Month:
May
Year:
2020
Address:
Marseille, France
Venue:
READI
SIG:
Publisher:
European Language Resources Association
Note:
Pages:
57–62
Language:
English
URL:
https://aclanthology.org/2020.readi-1.9
DOI:
Bibkey:
Cite (ACL):
Matthew Shardlow, Michael Cooper, and Marcos Zampieri. 2020. CompLex — A New Corpus for Lexical Complexity Prediction from Likert Scale Data. In Proceedings of the 1st Workshop on Tools and Resources to Empower People with REAding DIfficulties (READI), pages 57–62, Marseille, France. European Language Resources Association.
Cite (Informal):
CompLex — A New Corpus for Lexical Complexity Prediction from Likert Scale Data (Shardlow et al., READI 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.readi-1.9.pdf