Constructing a Credible Estimation for Overreporting of Climate Adaptation Funds in the Creditor Reporting System

Janos Borst, Thomas Wencker, Andreas Niekler


Abstract
Development funds are essential to finance climate change adaptation and are thus an important part of international climate policy. How ever, the absence of a common reporting practice makes it difficult to assess the amount and distribution of such funds. Research has questioned the credibility of reported figures, indicating that adaptation financing is in fact lower than published figures suggest. Projects claiming a greater relevance to climate change adaptation than they target are referred to as “overreported”. To estimate realistic rates of overreporting in large data sets over times, we propose an approach based on state-of-the-art text classification. To date, assessments of credibility have relied on small, manually evaluated samples. We use such a sample data set to train a classifier with an accuracy of 89.81%±0.83% (tenfold cross-validation) and extrapolate to larger data sets to identify overreporting. Additionally, we propose a method that incorporates evidence of smaller, higher-quality data to correct predicted rates using Bayes’ theorem. This enables a comparison of different annotation schemes to estimate the degree of overreporting in climate change adaptation. Our results support findings that indicate extensive overreporting of 32.03% with a credible interval of [19.81%; 48.34%].
Anthology ID:
2023.latechclfl-1.11
Volume:
Proceedings of the 7th Joint SIGHUM Workshop on Computational Linguistics for Cultural Heritage, Social Sciences, Humanities and Literature
Month:
May
Year:
2023
Address:
Dubrovnik, Croatia
Editors:
Stefania Degaetano-Ortlieb, Anna Kazantseva, Nils Reiter, Stan Szpakowicz
Venue:
LaTeCHCLfL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
99–109
Language:
URL:
https://aclanthology.org/2023.latechclfl-1.11
DOI:
10.18653/v1/2023.latechclfl-1.11
Bibkey:
Cite (ACL):
Janos Borst, Thomas Wencker, and Andreas Niekler. 2023. Constructing a Credible Estimation for Overreporting of Climate Adaptation Funds in the Creditor Reporting System. In Proceedings of the 7th Joint SIGHUM Workshop on Computational Linguistics for Cultural Heritage, Social Sciences, Humanities and Literature, pages 99–109, Dubrovnik, Croatia. Association for Computational Linguistics.
Cite (Informal):
Constructing a Credible Estimation for Overreporting of Climate Adaptation Funds in the Creditor Reporting System (Borst et al., LaTeCHCLfL 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.latechclfl-1.11.pdf