Grammatical Templates: Improving Text Difficulty Evaluation for Language Learners

Shuhan Wang, Erik Andersen


Abstract
Language students are most engaged while reading texts at an appropriate difficulty level. However, existing methods of evaluating text difficulty focus mainly on vocabulary and do not prioritize grammatical features, hence they do not work well for language learners with limited knowledge of grammar. In this paper, we introduce grammatical templates, the expert-identified units of grammar that students learn from class, as an important feature of text difficulty evaluation. Experimental classification results show that grammatical template features significantly improve text difficulty prediction accuracy over baseline readability features by 7.4%. Moreover,we build a simple and human-understandable text difficulty evaluation approach with 87.7% accuracy, using only 5 grammatical template features.
Anthology ID:
C16-1159
Volume:
Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers
Month:
December
Year:
2016
Address:
Osaka, Japan
Editors:
Yuji Matsumoto, Rashmi Prasad
Venue:
COLING
SIG:
Publisher:
The COLING 2016 Organizing Committee
Note:
Pages:
1692–1702
Language:
URL:
https://aclanthology.org/C16-1159
DOI:
Bibkey:
Cite (ACL):
Shuhan Wang and Erik Andersen. 2016. Grammatical Templates: Improving Text Difficulty Evaluation for Language Learners. In Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers, pages 1692–1702, Osaka, Japan. The COLING 2016 Organizing Committee.
Cite (Informal):
Grammatical Templates: Improving Text Difficulty Evaluation for Language Learners (Wang & Andersen, COLING 2016)
Copy Citation:
PDF:
https://aclanthology.org/C16-1159.pdf