Cognitively Aided Zero-Shot Automatic Essay Grading

Sandeep Mathias, Rudra Murthy, Diptesh Kanojia, Pushpak Bhattacharyya


Abstract
Automatic essay grading (AEG) is a process in which machines assign a grade to an essay written in response to a topic, called the prompt. Zero-shot AEG is when we train a system to grade essays written to a new prompt which was not present in our training data. In this paper, we describe a solution to the problem of zero-shot automatic essay grading, using cognitive information, in the form of gaze behaviour. Our experiments show that using gaze behaviour helps in improving the performance of AEG systems, especially when we provide a new essay written in response to a new prompt for scoring, by an average of almost 5 percentage points of QWK.
Anthology ID:
2020.icon-main.23
Volume:
Proceedings of the 17th International Conference on Natural Language Processing (ICON)
Month:
December
Year:
2020
Address:
Indian Institute of Technology Patna, Patna, India
Editors:
Pushpak Bhattacharyya, Dipti Misra Sharma, Rajeev Sangal
Venue:
ICON
SIG:
Publisher:
NLP Association of India (NLPAI)
Note:
Pages:
175–180
Language:
URL:
https://aclanthology.org/2020.icon-main.23
DOI:
Bibkey:
Cite (ACL):
Sandeep Mathias, Rudra Murthy, Diptesh Kanojia, and Pushpak Bhattacharyya. 2020. Cognitively Aided Zero-Shot Automatic Essay Grading. In Proceedings of the 17th International Conference on Natural Language Processing (ICON), pages 175–180, Indian Institute of Technology Patna, Patna, India. NLP Association of India (NLPAI).
Cite (Informal):
Cognitively Aided Zero-Shot Automatic Essay Grading (Mathias et al., ICON 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.icon-main.23.pdf