PrismAlign: Prior-Steered Multi-View VLM Alignment for Hallucination-Robust Table OCR

Guangyi Liu, Qianjun Huang, Boyu Hou


Abstract
Table extraction suffers from frequent structural errors and semantic hallucinations. We propose PrismAlign, a multi-VLM framework aligning diverse visual perspectives to resolve ambiguity. It integrates priors of table logic to assess output plausibility, decoupling structural alignment from cell content alignment. A Bayesian decision strategy maximizes alignment accuracy by exploiting the correlation between extraction errors and computable rule violations. Evaluated on open-source and custom VLMs, PrismAlign significantly reduces hallucinations and achieves state-of-the-art performance on OmniDocBench 1.5, as well as on the table category of CC-OCR and PureDocBench.
Anthology ID:
2026.emnlp-industry.181
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Pepa Atanasova, Gholamreza Haffari, Minghan Wang
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
3069–3078
Language:
URL:
https://aclanthology.org/2026.emnlp-industry.181/
DOI:
Bibkey:
Cite (ACL):
Guangyi Liu, Qianjun Huang, and Boyu Hou. 2026. PrismAlign: Prior-Steered Multi-View VLM Alignment for Hallucination-Robust Table OCR. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track, pages 3069–3078, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
PrismAlign: Prior-Steered Multi-View VLM Alignment for Hallucination-Robust Table OCR (Liu et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-industry.181.pdf