Ilyas Nagiyev
Author directory2026
SCOPE: Source Credibility and Outlet Profiling Engine
Ilyas Nagiyev | Miras Baisbay | Daniil Orel | Preslav Nakov
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: System Demonstrations
Ilyas Nagiyev | Miras Baisbay | Daniil Orel | Preslav Nakov
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: System Demonstrations
We present SCOPE, a multi-agent system for profiling news media outlets with respect to bias, factuality, and credibility. Given an outlet URL, SCOPE coordinates specialized agents for article acquisition, content analysis, external evidence search, scoring, and report generation. The system follows an MBFC-style methodology while making intermediate evidence and agent outputs inspectable through a structured demonstration interface. On a benchmark of 200 media outlets, SCOPE outperforms LLM-only, article-only, search-only, and media-background-check baselines on most metrics, achieving the lowest bias and factuality MAE, perfect failed-fact-check detection, and the lowest factual error rate. These results suggest that decomposed, evidence-grounded agent workflows can support more transparent and reliable media profiling. Our code is available at https://github.com/mbaisbay/SCOPE, and a live demonstration at https://scope-demo.streamlit.app/.