Graph Evidence Is Not Text Evidence: Serialization Faithfulness as Structural Invariance in Graph-Grounded Language Models

Lifan Hu


Abstract
Graph-grounded language models are usually evaluated by answer accuracy, yet a serialized prompt is a string representation of a graph rather than the graph itself. We argue that faithful graph-grounded reasoning requires the composed predictor F𝜃 ∘ z to be well-defined on graph-query equivalence classes: structurally equivalent graph-query pairs should induce the same prediction regardless of textual realization. We formalize this as a structural invariance property, decompose unfaithfulness into syntactic instability, semantic interference, and distractor susceptibility, and introduce corresponding diagnostics. On controlled graph reasoning tasks, DeepSeek-V4-Flash achieves 98.9% accuracy and near-perfect syntactic stability (FS = .975), yet its isomorphism consistency drops from .969 to .701 under semantic-name relabeling (∆sem = .268); only 72.9% of originally correct answers survive this transformation. Across four model families, we observe targeted semantic interference in high-accuracy models, broad unfaithfulness in weaker models, and near-perfect invariance as a capability ceiling. A graph-grounded LLM can be accurate without being structurally faithful: its predictions may fail to remain invariant under graph-equivalent textual relabelings.
Anthology ID:
2026.groundlm-1.23
Volume:
Proceedings of the 1st Workshop on Grounding Language Models: Learning Faithfully and Efficiently (GroundLM 2026)
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Yimu Wang, Yee Man Choi, Di Wu, Siqi Ouyang, Mozhgan Nasr Azadani, Yi R. (May) Fung
Venues:
GroundLM | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
305–309
Language:
URL:
https://aclanthology.org/2026.groundlm-1.23/
DOI:
Bibkey:
Cite (ACL):
Lifan Hu. 2026. Graph Evidence Is Not Text Evidence: Serialization Faithfulness as Structural Invariance in Graph-Grounded Language Models. In Proceedings of the 1st Workshop on Grounding Language Models: Learning Faithfully and Efficiently (GroundLM 2026), pages 305–309, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Graph Evidence Is Not Text Evidence: Serialization Faithfulness as Structural Invariance in Graph-Grounded Language Models (Hu, GroundLM 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.groundlm-1.23.pdf