Drift Inspector: Exploring and Measuring Scientific Drift with Atomic Contribution Claims

Vsevolod Karimov, Stepan Ostarkov, Anastasia Poroshina, Frolov Anatolii, Alexander Panchenko


Abstract
Scientific abstracts mix contributions with background, motivation, and meta-language, so tools that read them as-is cannot separate what a field produces from what it discusses. We present Drift Inspector, an open-source system for measuring and exploring how a research field changes over time at the level of Atomic Contribution Claims (ACCs): decontextualized, contribution-bearing propositions an LLM extracts from each abstract before analysis. The system clusters these claims across years into an interactive map where every trend traces back to the claims and papers behind it. Applied to six years of EMNLP, it shows the field shifting away from classic NLP tasks toward LLM-era capabilities such as reasoning and multimodality — a movement that keyword or whole-abstract counts blur. The released data extend beyond EMNLP: the same pipeline has processed the full ACL Anthology (346k claims, 80k abstracts, 423 venues). Extraction is human-validated and clustering checked against an external manually constructed taxonomy.
Anthology ID:
2026.emnlp-demos.13
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: System Demonstrations
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Sweta Agrawal, Alberto Abad
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
138–148
Language:
URL:
https://aclanthology.org/2026.emnlp-demos.13/
DOI:
Bibkey:
Cite (ACL):
Vsevolod Karimov, Stepan Ostarkov, Anastasia Poroshina, Frolov Anatolii, and Alexander Panchenko. 2026. Drift Inspector: Exploring and Measuring Scientific Drift with Atomic Contribution Claims. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: System Demonstrations, pages 138–148, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Drift Inspector: Exploring and Measuring Scientific Drift with Atomic Contribution Claims (Karimov et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-demos.13.pdf