Henry Makinde
Author directory2026
Psychmet- Measurement Foundational Competencies ChatBot
Henry Makinde | Hope Adegoke | Mubarak Mojoyinola
Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Full Papers
Henry Makinde | Hope Adegoke | Mubarak Mojoyinola
Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Full Papers
PsychMet is a domain-grounded chatbot that uses a GPT-4.1 conversational model with retrieval-augmented generation over a curated psychometrics corpus, with emphasis on IRT and NCME competencies. Using the RAGAS framework on a 30-question set, PsychMet achieved an Overall score of 0.539, with strengths in Answer Correctness (0.810) and Context Recall (0.671), moderate Faithfulness (0.588), and weaknesses in Answer Relevancy (0.284), Context Precision (0.425), and Context Relevancy (0.474). This pattern suggests that retrieval breadth is outpacing specificity. We outline targeted fixes — such as hybrid sparse+dense retrieval with light filtering and question-first prompting — to tighten focus without sacrificing coverage. PsychMet is accurate and transparently sourced for exploratory learning; with retrieval tightening and answer scoping, it can better support time-bound professional workflows.