Shouryadipta Sarkar
Author directory2026
Towards Automated Situation Awareness: A RAG-Based Framework for Peacebuilding Reports
Poli Nemkova | Suleyman Olcay Polat | Rafid Ishrak Jahan | Sagnik Ray Choudhury | Sun-Joo Lee | Shouryadipta Sarkar | Mark V. Albert
Proceedings of the Fifth Workshop on NLP for Positive Impact (NLP4PI)
Poli Nemkova | Suleyman Olcay Polat | Rafid Ishrak Jahan | Sagnik Ray Choudhury | Sun-Joo Lee | Shouryadipta Sarkar | Mark V. Albert
Proceedings of the Fifth Workshop on NLP for Positive Impact (NLP4PI)
Timely and accurate situation awareness underpins effective decision-making in humanitarian response, conflict monitoring, and peacebuilding. Yet, synthesizing heterogeneous and rapidly evolving information from news, conflict databases, and economic indicators remains labor-intensive and delays critical interventions. We present a Retrieval-Augmented Generation (RAG) system that autonomously produces structured, evidence-backed situation awareness reports by integrating real-time data from GDELT, ACLED, ReliefWeb, and World Bank APIs. To rigorously assess report quality without ground-truth references, we introduce a three-level reference-free evaluation framework combining automated NLP metrics, expert review by United Nations crisis analysts, and scalable LLM-as-a-Judge assessment. In a multi-country study across 15 conflict-prone regions, our system generated coherent, relevant, and actionable reports, with UNDP analysts estimating a ~50% reduction in report preparation time. These findings demonstrate the feasibility of deploying RAG-based systems for peacebuilding and humanitarian operations and provide a reproducible framework for generating and evaluating AI-assisted situational intelligence at scale.