CL-OCR: Fusing Layout Analysis and Adapting Recognition for Document Parsing in the Wild

Haijie Yuan, Yiming Zhang, Dekang Ran, Yi Chen, Xinming Wang, Jun Cao, Wenzhuo Liu, Xiao-Hui Li, Fei Zhu, Fei Yin, Cheng-Lin Liu


Abstract
Recent OCR models achieve strong results on document benchmarks, with several 1–2B OCR-specialized models surpassing much larger general multimodal LLMs (MLLMs). However, complex real-world documents often contain blur, cropping, curved text, handwriting, and unfamiliar structures, which remain challenging for current OCR systems. We trace this gap to a shift in the error source: errors on canonical benchmarks mainly arise from layout analysis, including localization, element classification, and reading order, while errors under these challenging conditions mainly arise from content recognition. To this end, we propose CL-OCR, a two-stage framework that first fuses semantic structure from an MLLM-based detector with geometric candidates from a vision detector to obtain calibrated layouts, then enhances recognition via a shared LoRA adapter gated by a lightweight router. We further construct OCRWildBench and a companion training split to study these conditions. Experiments show that CL-OCR remains competitive on canonical benchmarks and achieves the strongest overall performance among OCR-specialized models on OCRWildBench.
Anthology ID:
2026.findings-emnlp.1749
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
37416–37437
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.1749/
DOI:
Bibkey:
Cite (ACL):
Haijie Yuan, Yiming Zhang, Dekang Ran, Yi Chen, Xinming Wang, Jun Cao, Wenzhuo Liu, Xiao-Hui Li, Fei Zhu, Fei Yin, and Cheng-Lin Liu. 2026. CL-OCR: Fusing Layout Analysis and Adapting Recognition for Document Parsing in the Wild. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 37416–37437, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
CL-OCR: Fusing Layout Analysis and Adapting Recognition for Document Parsing in the Wild (Yuan et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.1749.pdf