EQUAL: Evaluating Pluralistic Alignment of LLMs Across Educational Perspectives

MD Azizul Hoque, Mark Dras, Usman Naseem


Abstract
Large Language Models (LLMs) are increasingly deployed in education, powering tutoring systems, automated feedback, and curriculum support. Most alignment techniques optimize toward a single aggregated notion of human preference, a mismatch for education, where legitimate disagreement is the norm. Students, parents, teachers, and policymakers often hold deeply conflicting views on assessment, discipline, curriculum, and institutional authority, reflecting genuine value pluralism rather than noise. Pluralistic alignment, which seeks to represent and navigate this diversity, offers a principled path forward. Despite growing interest, no benchmark evaluates how well LLMs handle value-laden disagreement in educational contexts. To address this, we introduce EQUAL (Eliciting QUality sAmples of pLuralistic alignment in education), comprising 14,270 samples—5,824 value-laden scenarios and 8,446 multiple-choice questions, curated from six sources, including over two decades of Phi Delta Kappa polling data, via a lexical filtering pipeline and human validation. EQUAL supports evaluation across Overton, Steerable, and Distributional paradigms. We benchmark nine LLMs under four approaches and additionally evaluate three frontier reasoning-capable models. No single method consistently satisfies pluralistic objectives. These findings provide a foundation for future research on pluralistic alignment in educational AI.
Anthology ID:
2026.emnlp-main.1909
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
43491–43515
Language:
URL:
https://aclanthology.org/2026.emnlp-main.1909/
DOI:
Bibkey:
Cite (ACL):
MD Azizul Hoque, Mark Dras, and Usman Naseem. 2026. EQUAL: Evaluating Pluralistic Alignment of LLMs Across Educational Perspectives. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 43491–43515, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
EQUAL: Evaluating Pluralistic Alignment of LLMs Across Educational Perspectives (Hoque et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.1909.pdf