Evaluating Generative AI as a Mentor Resource: Bias and Implementation Challenges

Jimin Lee, Alena G Esposito


Abstract
We explored how students’ perceptions of helpfulness and caring skew their ability to identify AI versus human mentorship responses. Emotionally resonant responses often lead to misattributions, indicating perceptual biases that shape mentorship judgments. The findings inform ethical, relational, and effective integration of AI in student support.
Anthology ID:
2025.aimecon-main.14
Volume:
Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Full Papers
Month:
October
Year:
2025
Address:
Wyndham Grand Pittsburgh, Downtown, Pittsburgh, Pennsylvania, United States
Editors:
Joshua Wilson, Christopher Ormerod, Magdalen Beiting Parrish
Venue:
AIME-Con
SIG:
Publisher:
National Council on Measurement in Education (NCME)
Note:
Pages:
126–133
Language:
URL:
https://aclanthology.org/2025.aimecon-main.14/
DOI:
Bibkey:
Cite (ACL):
Jimin Lee and Alena G Esposito. 2025. Evaluating Generative AI as a Mentor Resource: Bias and Implementation Challenges. In Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Full Papers, pages 126–133, Wyndham Grand Pittsburgh, Downtown, Pittsburgh, Pennsylvania, United States. National Council on Measurement in Education (NCME).
Cite (Informal):
Evaluating Generative AI as a Mentor Resource: Bias and Implementation Challenges (Lee & Esposito, AIME-Con 2025)
Copy Citation:
PDF:
https://aclanthology.org/2025.aimecon-main.14.pdf