Automated Approaches for Scoring Math Misunderstandings in Student Self-Explanations

Scott Crossley, Bethany Rittle-Johnson, Rebecca Adler, L Burleigh, Jules King, Meg Benner


Abstract
This study reports on an open data science competition based on a benchmark dataset of mathematics misunderstandings, comprising over 52,000 mathematics explanations written to justify answer choices from 15 multiple-choice questions that were labeled by expert human annotators. Competitors were tasked with correctly classifying the explanations and any misunderstandings. By combining stable validation methods with efficient inference and enriched training data, top teams achieved high accuracy scores that correctly classified the explanations as correct, a misunderstanding, or neither and, if it did have a misunderstanding, what type of misunderstanding it was.
Anthology ID:
2026.aimecon-main.33
Volume:
Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Full Papers
Month:
October
Year:
2026
Address:
Wyndham Grand Pittsburgh Downtown, Pittsburgh, Pennsylvania, United States
Editors:
Joshua Wilson, Christopher Ormerod, Magdalen Beiting-Parrish
Venue:
AIME-Con
SIG:
Publisher:
National Council on Measurement in Education (NCME)
Note:
Pages:
297–302
Language:
URL:
https://aclanthology.org/2026.aimecon-main.33/
DOI:
Bibkey:
Cite (ACL):
Scott Crossley, Bethany Rittle-Johnson, Rebecca Adler, L Burleigh, Jules King, and Meg Benner. 2026. Automated Approaches for Scoring Math Misunderstandings in Student Self-Explanations. In Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Full Papers, pages 297–302, Wyndham Grand Pittsburgh Downtown, Pittsburgh, Pennsylvania, United States. National Council on Measurement in Education (NCME).
Cite (Informal):
Automated Approaches for Scoring Math Misunderstandings in Student Self-Explanations (Crossley et al., AIME-Con 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.aimecon-main.33.pdf