Before You Trust the Count: Auditing Multilingual Sustainable Development Goal News

Sergey Volkov


Abstract
News monitoring of the Sustainable Development Goals (SDGs) can be distorted by a missing archive interval, a broad lexical rule, or duplicated evidence. We study how to audit such conclusions when target-domain relevance labels are unavailable. Our case comprises 16,060,006 URL-unique candidates retrieved from English, Spanish, Russian, and Chinese GDELT Article List (GAL) titles observed in 2024–2025. We replace whole-day gap accounting with a minute-interval ledger, correct public-label processing to distinguish accepted, rejected, and unassessed text–goal pairs, and compare weak signals on source-grouped public benchmarks. We find that weak fusion does not satisfy our predefined retention rule. We therefore use a claim-level audit with three outcomes: supported under tested assumptions, reversed by a specific measurement choice, or blocked by missing evidence. Paired translated headlines reveal disagreement between language-specific instruments. Controlled engineering and semantic streams let us measure false releases, retained correct claims, and release rate against separate references. The audit lowers false-release rates on semantic tracks but abstains too often on the engineering track. The released artifact makes these tradeoffs reproducible. Agreement across specifications shows robustness to the tested checks; it does not prove semantic correctness or accuracy on unlabeled news titles.
Anthology ID:
2026.nlp4pi-1.7
Volume:
Proceedings of the Fifth Workshop on NLP for Positive Impact (NLP4PI)
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Katherine Atwell, Angana Borah, Daryna Dementieva, Elisa Kreiss, Neema Kotonya, Jiarui Liu, Liz Olson, Ruyuan Wan, Jieyu Zhao
Venues:
NLP4PI | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
67–76
Language:
URL:
https://aclanthology.org/2026.nlp4pi-1.7/
DOI:
Bibkey:
Cite (ACL):
Sergey Volkov. 2026. Before You Trust the Count: Auditing Multilingual Sustainable Development Goal News. In Proceedings of the Fifth Workshop on NLP for Positive Impact (NLP4PI), pages 67–76, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Before You Trust the Count: Auditing Multilingual Sustainable Development Goal News (Volkov, NLP4PI 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.nlp4pi-1.7.pdf