Give Me More Feedback: Annotating Argument Persuasiveness and Related Attributes in Student Essays

Winston Carlile, Nishant Gurrapadi, Zixuan Ke, Vincent Ng


Abstract
While argument persuasiveness is one of the most important dimensions of argumentative essay quality, it is relatively little studied in automated essay scoring research. Progress on scoring argument persuasiveness is hindered in part by the scarcity of annotated corpora. We present the first corpus of essays that are simultaneously annotated with argument components, argument persuasiveness scores, and attributes of argument components that impact an argument’s persuasiveness. This corpus could trigger the development of novel computational models concerning argument persuasiveness that provide useful feedback to students on why their arguments are (un)persuasive in addition to how persuasive they are.
Anthology ID:
P18-1058
Volume:
Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
July
Year:
2018
Address:
Melbourne, Australia
Editors:
Iryna Gurevych, Yusuke Miyao
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
621–631
Language:
URL:
https://aclanthology.org/P18-1058
DOI:
10.18653/v1/P18-1058
Bibkey:
Cite (ACL):
Winston Carlile, Nishant Gurrapadi, Zixuan Ke, and Vincent Ng. 2018. Give Me More Feedback: Annotating Argument Persuasiveness and Related Attributes in Student Essays. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 621–631, Melbourne, Australia. Association for Computational Linguistics.
Cite (Informal):
Give Me More Feedback: Annotating Argument Persuasiveness and Related Attributes in Student Essays (Carlile et al., ACL 2018)
Copy Citation:
PDF:
https://aclanthology.org/P18-1058.pdf
Poster:
 P18-1058.Poster.pdf