Pre-Data Embedding Diagnostics for Construct Validity in Multi-Domain Instruments

Youngmi Cho, Tong Wu, Hyeonjoo Oh


Abstract
Centroid margin, an embedding-based measure of relative domain distinctiveness, was evaluated as a pre-data item-selection tool for multi-domain instruments. Across four samples, centroid-guided selection improved model fit and discriminant validity, whereas own-domain cosine similarity increased overlap among closely related domains, revealing a key limitation of absolute similarity metrics.
Anthology ID:
2026.aimecon-main.62
Volume:
Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Full Papers
Month:
October
Year:
2026
Address:
Wyndham Grand Pittsburgh Downtown, Pittsburgh, Pennsylvania, United States
Editors:
Joshua Wilson, Christopher Ormerod, Magdalen Beiting-Parrish
Venue:
AIME-Con
SIG:
Publisher:
National Council on Measurement in Education (NCME)
Note:
Pages:
551–559
Language:
URL:
https://aclanthology.org/2026.aimecon-main.62/
DOI:
Bibkey:
Cite (ACL):
Youngmi Cho, Tong Wu, and Hyeonjoo Oh. 2026. Pre-Data Embedding Diagnostics for Construct Validity in Multi-Domain Instruments. In Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Full Papers, pages 551–559, Wyndham Grand Pittsburgh Downtown, Pittsburgh, Pennsylvania, United States. National Council on Measurement in Education (NCME).
Cite (Informal):
Pre-Data Embedding Diagnostics for Construct Validity in Multi-Domain Instruments (Cho et al., AIME-Con 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.aimecon-main.62.pdf