BeyondAtoms: Benchmarking and Verifying Relational Factuality Beyond Atomic Facts

Zeyang Liu, Jingfeng Xue, Jiarun Fu, Wenbiao Du, Xiuqi Yang, Yifeng Fu, Junbao Chen, Yong Wang


Abstract
As Large Language Models (LLMs) increasingly generate reasoning-driven outputs that weave isolated events into intricate logical topologies, factuality depends not only on isolated atomic facts but critically on the faithful relations connecting them. However, current verification paradigms prioritize individual facts and remain fundamentally blind to relational distortions. This oversight creates a dangerous false sense of security, where verifiers inadvertently endorse relationally corrupted claims simply because their constituent events are factual. Furthermore, the community lacks a systematic benchmark to evaluate this crucial relational layer. To address these critical vulnerabilities, we introduce BeyondAtoms, a novel benchmark for relational fact verification. Our evaluations reveal that generic verification pipelines often fail by misclassifying relational manipulations as supported. While explicitly guided reasoning models can resolve these structural errors, they incur prohibitive computational costs. To counter this pervasive relation blindness, we propose CARVE, a completely training-free verification framework. By decoupling structural dependencies through deterministic extraction and bi-directional relational alignment, CARVE achieves a favorable accuracy–efficiency trade-off: it remains highly competitive on relational and general fact verification while avoiding the heavy inference cost of reasoning-based LLMs.
Anthology ID:
2026.emnlp-main.289
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
6620–6637
Language:
URL:
https://aclanthology.org/2026.emnlp-main.289/
DOI:
Bibkey:
Cite (ACL):
Zeyang Liu, Jingfeng Xue, Jiarun Fu, Wenbiao Du, Xiuqi Yang, Yifeng Fu, Junbao Chen, and Yong Wang. 2026. BeyondAtoms: Benchmarking and Verifying Relational Factuality Beyond Atomic Facts. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 6620–6637, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
BeyondAtoms: Benchmarking and Verifying Relational Factuality Beyond Atomic Facts (Liu et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.289.pdf