Measuring the User, Not the Model: Critical AI Literacy

Derek Briggs


Abstract
Researchers claim to measure large language models. Measurement and evaluation differ epistemically: evaluation asks whether outputs are fit for use; measurement requires a pre-existing quantitative attribute. LLM variability is designed, not discovered; evaluate models, measure people. Critical AI literacy proves, in simulation, most measurable where AI is least capable.
Anthology ID:
2026.aimecon-main.45
Volume:
Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Full Papers
Month:
October
Year:
2026
Address:
Wyndham Grand Pittsburgh Downtown, Pittsburgh, Pennsylvania, United States
Editors:
Joshua Wilson, Christopher Ormerod, Magdalen Beiting-Parrish
Venue:
AIME-Con
SIG:
Publisher:
National Council on Measurement in Education (NCME)
Note:
Pages:
407–412
Language:
URL:
https://aclanthology.org/2026.aimecon-main.45/
DOI:
Bibkey:
Cite (ACL):
Derek Briggs. 2026. Measuring the User, Not the Model: Critical AI Literacy. In Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Full Papers, pages 407–412, Wyndham Grand Pittsburgh Downtown, Pittsburgh, Pennsylvania, United States. National Council on Measurement in Education (NCME).
Cite (Informal):
Measuring the User, Not the Model: Critical AI Literacy (Briggs, AIME-Con 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.aimecon-main.45.pdf