NEAR: Neighborhood-Aware Context Reconstruction for Ultra-Long Document Reading Comprehension of LLMs

Han Li, Xuanang Chen, Ben He, Le Sun


Abstract
Large language models (LLMs) remain challenged by ultra-long document understanding. A common solution is to segment documents into chunks and retrieve those relevant to a query, but this can disrupt semantic and logical coherence by ignoring dependencies between chunks. We propose NEAR (NEighborhood-Aware context Reconstruction), a lightweight, training-free framework that reconstructs coherent context from fragmented segments. NEAR represents each document as a dual-layer neighborhood graph, connecting chunks via topical neighbors to capture long-range semantic relations and physical neighbors to preserve local continuity. An iterative dual-pool exploration traverses chunks from both global and local neighborhoods, and collected chunks are selectively expanded and reordered according to their original positions to form a coherent input context. Extensive experiments on multiple long-document question answering benchmarks demonstrate that NEAR improves comprehension performance while maintaining low latency and memory usage.
Anthology ID:
2026.emnlp-main.886
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
20434–20453
Language:
URL:
https://aclanthology.org/2026.emnlp-main.886/
DOI:
Bibkey:
Cite (ACL):
Han Li, Xuanang Chen, Ben He, and Le Sun. 2026. NEAR: Neighborhood-Aware Context Reconstruction for Ultra-Long Document Reading Comprehension of LLMs. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 20434–20453, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
NEAR: Neighborhood-Aware Context Reconstruction for Ultra-Long Document Reading Comprehension of LLMs (Li et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.886.pdf