Robert J. Gaizauskas
Author directoryOther people with similar names: Robert Gaizauskas
2026
Image-Informed Post-OCR Correction with Vision-Language Models
Alan Thomas | Xianyuan Liu | Haiping Lu | Robert J. Gaizauskas
Findings of the Association for Computational Linguistics: EMNLP 2026
Alan Thomas | Xianyuan Liu | Haiping Lu | Robert J. Gaizauskas
Findings of the Association for Computational Linguistics: EMNLP 2026
Improving the quality of OCR transcriptions is crucial for researchers working with digital archives, as OCR errors hinder readability and downstream NLP tasks. While prior work has focused on seq2seq neural machine translation and, more recently, prompt-based approaches with large language models (LLMs), these methods rely solely on text, overlooking the visual characteristics of source documents. In this work, we explore the potential of vision-language models (VLMs) for post-OCR correction to evaluate the impact of integrating visual information. We conduct experiments on the BLN600 dataset of 19th-century newspaper articles, comparing Llama 3.2 Vision and Qwen 2.5 VL to their text-only LLM counterparts. Our results show that VLMs significantly outperform LLMs, achieving approximately 90% reduction in character and word error rates, with the optimal setting being one that takes as input both document image and prior noisy OCR. This suggests that VLM-based post-OCR correction can be a viable and effective approach for correcting back catalogues of poorly OCR’ed historical documents and improving the usability of digital archives.