An Exploratory Study of Argumentative Writing by Young Students: A transformer-based Approach

Debanjan Ghosh, Beata Beigman Klebanov, Yi Song


Abstract
We present a computational exploration of argument critique writing by young students. Middle school students were asked to criticize an argument presented in the prompt, focusing on identifying and explaining the reasoning flaws. This task resembles an established college-level argument critique task. Lexical and discourse features that utilize detailed domain knowledge to identify critiques exist for the college task but do not perform well on the young students’ data. Instead, transformer-based architecture (e.g., BERT) fine-tuned on a large corpus of critique essays from the college task performs much better (over 20% improvement in F1 score). Analysis of the performance of various configurations of the system suggests that while children’s writing does not exhibit the standard discourse structure of an argumentative essay, it does share basic local sequential structures with the more mature writers.
Anthology ID:
2020.bea-1.14
Volume:
Proceedings of the Fifteenth Workshop on Innovative Use of NLP for Building Educational Applications
Month:
July
Year:
2020
Address:
Seattle, WA, USA → Online
Editors:
Jill Burstein, Ekaterina Kochmar, Claudia Leacock, Nitin Madnani, Ildikó Pilán, Helen Yannakoudakis, Torsten Zesch
Venue:
BEA
SIG:
SIGEDU
Publisher:
Association for Computational Linguistics
Note:
Pages:
145–150
Language:
URL:
https://aclanthology.org/2020.bea-1.14
DOI:
10.18653/v1/2020.bea-1.14
Bibkey:
Cite (ACL):
Debanjan Ghosh, Beata Beigman Klebanov, and Yi Song. 2020. An Exploratory Study of Argumentative Writing by Young Students: A transformer-based Approach. In Proceedings of the Fifteenth Workshop on Innovative Use of NLP for Building Educational Applications, pages 145–150, Seattle, WA, USA → Online. Association for Computational Linguistics.
Cite (Informal):
An Exploratory Study of Argumentative Writing by Young Students: A transformer-based Approach (Ghosh et al., BEA 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.bea-1.14.pdf