A Fluctuation Smoothing Approach for Unsupervised Automatic Short Answer Grading

Shourya Roy, Sandipan Dandapat, Y. Narahari


Abstract
We offer a fluctuation smoothing computational approach for unsupervised automatic short answer grading (ASAG) techniques in the educational ecosystem. A major drawback of the existing techniques is the significant effect that variations in model answers could have on their performances. The proposed fluctuation smoothing approach, based on classical sequential pattern mining, exploits lexical overlap in students’ answers to any typical question. We empirically demonstrate using multiple datasets that the proposed approach improves the overall performance and significantly reduces (up to 63%) variation in performance (standard deviation) of unsupervised ASAG techniques. We bring in additional benchmarks such as (a) paraphrasing of model answers and (b) using answers by k top performing students as model answers, to amplify the benefits of the proposed approach.
Anthology ID:
W16-4911
Volume:
Proceedings of the 3rd Workshop on Natural Language Processing Techniques for Educational Applications (NLPTEA2016)
Month:
December
Year:
2016
Address:
Osaka, Japan
Editors:
Hsin-Hsi Chen, Yuen-Hsien Tseng, Vincent Ng, Xiaofei Lu
Venue:
NLP-TEA
SIG:
Publisher:
The COLING 2016 Organizing Committee
Note:
Pages:
82–91
Language:
URL:
https://aclanthology.org/W16-4911
DOI:
Bibkey:
Cite (ACL):
Shourya Roy, Sandipan Dandapat, and Y. Narahari. 2016. A Fluctuation Smoothing Approach for Unsupervised Automatic Short Answer Grading. In Proceedings of the 3rd Workshop on Natural Language Processing Techniques for Educational Applications (NLPTEA2016), pages 82–91, Osaka, Japan. The COLING 2016 Organizing Committee.
Cite (Informal):
A Fluctuation Smoothing Approach for Unsupervised Automatic Short Answer Grading (Roy et al., NLP-TEA 2016)
Copy Citation:
PDF:
https://aclanthology.org/W16-4911.pdf