SAGE: How Well Do LLMs Align with Classical Chinese Philosophy?

Yuying Zhao, Sirui Chen, Yixin Liu, Xuemei Jia, Lingxi Min, Zheng Wang


Abstract
The growing deployment of large language models (LLMs) in socially consequential settings makes it increasingly important to understand the value systems they encode and the moral judgments they produce. However, existing evaluations are largely grounded in Western ethical traditions, leaving non-Western moral perspectives underexplored. To address this gap, we introduce Sage, a benchmark for evaluating LLMs through the lens of Classical Chinese philosophy. Sage is grounded in major Pre-Qin philosophical debates and represents normative alignment in a continuous six-dimensional value space. It includes three task types and is constructed from over 4,000 passages spanning ten philosophical schools. Experiments on eight leading LLMs reveal that models occupy highly similar regions in the proposed value space, exhibit a clear gap between self-declared philosophical identities and benchmark-measured behavior, and show systematically different reasoning patterns across task granularities. Code and data will be released after publication.
Anthology ID:
2026.emnlp-main.1429
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
32636–32662
Language:
URL:
https://aclanthology.org/2026.emnlp-main.1429/
DOI:
Bibkey:
Cite (ACL):
Yuying Zhao, Sirui Chen, Yixin Liu, Xuemei Jia, Lingxi Min, and Zheng Wang. 2026. SAGE: How Well Do LLMs Align with Classical Chinese Philosophy?. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 32636–32662, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
SAGE: How Well Do LLMs Align with Classical Chinese Philosophy? (Zhao et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.1429.pdf