Retrieving Climate Change Adaptation Concepts from World Heritage Management Plans in the Netherlands

Vedant Jumle, Orhan Agaoglu, Laurens Mol, Edgar Salas Gironés, Nan Bai


Abstract
Monitoring climate change adaptation (CCA) in the heritage sector, especially in the context of World Heritage (WH) management, requires systematic analyses of policy documents for CCA strategies, a process that is difficult to scale. We ask whether automated retrieval systems can prioritise expert annotation effort: given a CCA concept, can a system rank passages of a management plan so that those an expert would annotate appear near the top, without any in-domain supervision? This objective is formulated as an information retrieval problem with a new benchmark dataset on climate-adaptive heritage management strategies, created from expert-labelled text chunks in official Management Plans of 11 Dutch WH properties. Four retrieval approaches (BM25, a bi-encoder, a dense retriever with reranker, and a cross-encoder reranker) are evaluated and compared. The cross-encoder reranker achieves the strongest performance across labels. An LLM-as-judge evaluation further shows that top-ranked unlabelled chunks could be relevant, suggesting that the existing annotations are precise but not exhaustive. Per-label analysis identifies which concepts are automatically retrievable and which remain beyond the reach of general-purpose retrieval. Our benchmark establishes a foundation for scalable mapping and monitoring of climate change adaptation in the context of heritage management.
Anthology ID:
2026.climatenlp-1.13
Volume:
Proceedings of the 3rd Workshop on Natural Language Processing Meets Climate Change (ClimateNLP 2026)
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Tobias Schimanski, Aida Usmanova, Gaku Morio, Jingwei Ni, Kalyan Dutia, Seyed Saeid Vaghefi, Dominik Stammbach, Markus Leippold
Venues:
ClimateNLP | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
170–182
Language:
URL:
https://aclanthology.org/2026.climatenlp-1.13/
DOI:
Bibkey:
Cite (ACL):
Vedant Jumle, Orhan Agaoglu, Laurens Mol, Edgar Salas Gironés, and Nan Bai. 2026. Retrieving Climate Change Adaptation Concepts from World Heritage Management Plans in the Netherlands. In Proceedings of the 3rd Workshop on Natural Language Processing Meets Climate Change (ClimateNLP 2026), pages 170–182, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Retrieving Climate Change Adaptation Concepts from World Heritage Management Plans in the Netherlands (Jumle et al., ClimateNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.climatenlp-1.13.pdf