Using XGBoost to Construct a Vertically Skill Difficulty Scale

John Bielinski


Abstract
An XGBoost prediction model was fitted to online skill practice data for a collection of 1800+ skills to construct a vertically aligned skill difficulty scale spanning kindergarten through 8th grade math. The results were validated through association with an independently derived Rasch vertical scale.
Anthology ID:
2026.aimecon-main.26
Volume:
Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Full Papers
Month:
October
Year:
2026
Address:
Wyndham Grand Pittsburgh Downtown, Pittsburgh, Pennsylvania, United States
Editors:
Joshua Wilson, Christopher Ormerod, Magdalen Beiting-Parrish
Venue:
AIME-Con
SIG:
Publisher:
National Council on Measurement in Education (NCME)
Note:
Pages:
239–244
Language:
URL:
https://aclanthology.org/2026.aimecon-main.26/
DOI:
Bibkey:
Cite (ACL):
John Bielinski. 2026. Using XGBoost to Construct a Vertically Skill Difficulty Scale. In Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Full Papers, pages 239–244, Wyndham Grand Pittsburgh Downtown, Pittsburgh, Pennsylvania, United States. National Council on Measurement in Education (NCME).
Cite (Informal):
Using XGBoost to Construct a Vertically Skill Difficulty Scale (Bielinski, AIME-Con 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.aimecon-main.26.pdf