Automatic Grading of Student Work Using Simulated Rubric-Based Data and GenAI Models

Yiyao Yang, Yasemin Gulbahar


Abstract
Grading assessment in data science faces challenges related to scalability, consistency, and fairness. Synthetic dataset and GenAI enable us to simulate realistic code samples and automatically evaluate using rubric-driven systems. The research proposes an automatic grading system for generated Python code samples and explores GenAI grading reliability through human-AI comparison.
Anthology ID:
2025.aimecon-wip.5
Volume:
Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Works in Progress
Month:
October
Year:
2025
Address:
Wyndham Grand Pittsburgh, Downtown, Pittsburgh, Pennsylvania, United States
Editors:
Joshua Wilson, Christopher Ormerod, Magdalen Beiting Parrish
Venue:
AIME-Con
SIG:
Publisher:
National Council on Measurement in Education (NCME)
Note:
Pages:
34–39
Language:
URL:
https://aclanthology.org/2025.aimecon-wip.5/
DOI:
Bibkey:
Cite (ACL):
Yiyao Yang and Yasemin Gulbahar. 2025. Automatic Grading of Student Work Using Simulated Rubric-Based Data and GenAI Models. In Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Works in Progress, pages 34–39, Wyndham Grand Pittsburgh, Downtown, Pittsburgh, Pennsylvania, United States. National Council on Measurement in Education (NCME).
Cite (Informal):
Automatic Grading of Student Work Using Simulated Rubric-Based Data and GenAI Models (Yang & Gulbahar, AIME-Con 2025)
Copy Citation:
PDF:
https://aclanthology.org/2025.aimecon-wip.5.pdf