Medical Item Difficulty Prediction Using Machine Learning

Hope Oluwaseun Adegoke, Ying Du, Andrew Dwyer


Abstract
This project aims to use machine learning models to predict a medical exam item difficulty by combining item metadata, linguistic features, word embeddings, and semantic similarity measures with a sample size of 1000 items. The goal is to improve the accuracy of difficulty prediction in medical assessment.
Anthology ID:
2025.aimecon-wip.22
Volume:
Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Works in Progress
Month:
October
Year:
2025
Address:
Wyndham Grand Pittsburgh, Downtown, Pittsburgh, Pennsylvania, United States
Editors:
Joshua Wilson, Christopher Ormerod, Magdalen Beiting Parrish
Venue:
AIME-Con
SIG:
Publisher:
National Council on Measurement in Education (NCME)
Note:
Pages:
185–190
Language:
URL:
https://aclanthology.org/2025.aimecon-wip.22/
DOI:
Bibkey:
Cite (ACL):
Hope Oluwaseun Adegoke, Ying Du, and Andrew Dwyer. 2025. Medical Item Difficulty Prediction Using Machine Learning. In Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Works in Progress, pages 185–190, Wyndham Grand Pittsburgh, Downtown, Pittsburgh, Pennsylvania, United States. National Council on Measurement in Education (NCME).
Cite (Informal):
Medical Item Difficulty Prediction Using Machine Learning (Adegoke et al., AIME-Con 2025)
Copy Citation:
PDF:
https://aclanthology.org/2025.aimecon-wip.22.pdf