Josua Kowalzik
Author directory2026
Epistemic Twins: Enabling a Symbolic Science of Language Model Knowledge
Simon Razniewski | Shrestha Ghosh | Luca Giordano | Yujia Hu | Josua Kowalzik | Tuan-Phong Nguyen
Proceedings of the 11th Workshop on Automated Knowledge Base Construction (AKBC 2026)
Simon Razniewski | Shrestha Ghosh | Luca Giordano | Yujia Hu | Josua Kowalzik | Tuan-Phong Nguyen
Proceedings of the 11th Workshop on Automated Knowledge Base Construction (AKBC 2026)
Large Language Models (LLMs) are impactful yet opaque artifacts. Subsymbolic by design, they are defined by billions of numeric weights that interact in a largely inscrutable manner. Current analysis paradigms are either black-box benchmarks that test model performance on pre-defined tasks, or mechanistic interpretability approaches that trace back outputs to specific weights. Both analysis methods are limited by the experimenter’s hypothesis space - one must know what to look for to find it. In this article, we argue for a third, radically different analysis paradigm: Epistemic Twins. We propose constructing large-scale symbolic approximations of LLMs in human-readable formats. This enables the comprehensive inspection of factual knowledge (or beliefs) inherent in the model without predefining hypotheses, facilitating large-scale auditing towards better understanding and explainability.