Measuring the Evolution of a Scientific Field through Citation Frames

David Jurgens, Srijan Kumar, Raine Hoover, Dan McFarland, Dan Jurafsky


Abstract
Citations have long been used to characterize the state of a scientific field and to identify influential works. However, writers use citations for different purposes, and this varied purpose influences uptake by future scholars. Unfortunately, our understanding of how scholars use and frame citations has been limited to small-scale manual citation analysis of individual papers. We perform the largest behavioral study of citations to date, analyzing how scientific works frame their contributions through different types of citations and how this framing affects the field as a whole. We introduce a new dataset of nearly 2,000 citations annotated for their function, and use it to develop a state-of-the-art classifier and label the papers of an entire field: Natural Language Processing. We then show how differences in framing affect scientific uptake and reveal the evolution of the publication venues and the field as a whole. We demonstrate that authors are sensitive to discourse structure and publication venue when citing, and that how a paper frames its work through citations is predictive of the citation count it will receive. Finally, we use changes in citation framing to show that the field of NLP is undergoing a significant increase in consensus.
Anthology ID:
Q18-1028
Volume:
Transactions of the Association for Computational Linguistics, Volume 6
Month:
Year:
2018
Address:
Cambridge, MA
Editors:
Lillian Lee, Mark Johnson, Kristina Toutanova, Brian Roark
Venue:
TACL
SIG:
Publisher:
MIT Press
Note:
Pages:
391–406
Language:
URL:
https://aclanthology.org/Q18-1028
DOI:
10.1162/tacl_a_00028
Bibkey:
Cite (ACL):
David Jurgens, Srijan Kumar, Raine Hoover, Dan McFarland, and Dan Jurafsky. 2018. Measuring the Evolution of a Scientific Field through Citation Frames. Transactions of the Association for Computational Linguistics, 6:391–406.
Cite (Informal):
Measuring the Evolution of a Scientific Field through Citation Frames (Jurgens et al., TACL 2018)
Copy Citation:
PDF:
https://aclanthology.org/Q18-1028.pdf
Video:
 https://aclanthology.org/Q18-1028.mp4
Data
ACL ARCSciCite