Automated essay scoring with string kernels and word embeddings

Mădălina Cozma, Andrei Butnaru, Radu Tudor Ionescu


Abstract
In this work, we present an approach based on combining string kernels and word embeddings for automatic essay scoring. String kernels capture the similarity among strings based on counting common character n-grams, which are a low-level yet powerful type of feature, demonstrating state-of-the-art results in various text classification tasks such as Arabic dialect identification or native language identification. To our best knowledge, we are the first to apply string kernels to automatically score essays. We are also the first to combine them with a high-level semantic feature representation, namely the bag-of-super-word-embeddings. We report the best performance on the Automated Student Assessment Prize data set, in both in-domain and cross-domain settings, surpassing recent state-of-the-art deep learning approaches.
Anthology ID:
P18-2080
Volume:
Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)
Month:
July
Year:
2018
Address:
Melbourne, Australia
Editors:
Iryna Gurevych, Yusuke Miyao
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
503–509
Language:
URL:
https://aclanthology.org/P18-2080
DOI:
10.18653/v1/P18-2080
Bibkey:
Cite (ACL):
Mădălina Cozma, Andrei Butnaru, and Radu Tudor Ionescu. 2018. Automated essay scoring with string kernels and word embeddings. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pages 503–509, Melbourne, Australia. Association for Computational Linguistics.
Cite (Informal):
Automated essay scoring with string kernels and word embeddings (Cozma et al., ACL 2018)
Copy Citation:
PDF:
https://aclanthology.org/P18-2080.pdf
Poster:
 P18-2080.Poster.pdf
Data
ASAP-AES