A Diachronic Analysis of Paradigm Shifts in NLP Research: When, How, and Why?

Aniket Pramanick, Yufang Hou, Saif Mohammad, Iryna Gurevych


Abstract
Understanding the fundamental concepts and trends in a scientific field is crucial for keeping abreast of its continuous advancement. In this study, we propose a systematic framework for analyzing the evolution of research topics in a scientific field using causal discovery and inference techniques. We define three variables to encompass diverse facets of the evolution of research topics within NLP and utilize a causal discovery algorithm to unveil the causal connections among these variables using observational data. Subsequently, we leverage this structure to measure the intensity of these relationships. By conducting extensive experiments on the ACL Anthology corpus, we demonstrate that our framework effectively uncovers evolutionary trends and the underlying causes for a wide range of NLP research topics. Specifically, we show that tasks and methods are primary drivers of research in NLP, with datasets following, while metrics have minimal impact.
Anthology ID:
2023.emnlp-main.142
Volume:
Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing
Month:
December
Year:
2023
Address:
Singapore
Editors:
Houda Bouamor, Juan Pino, Kalika Bali
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
2312–2326
Language:
URL:
https://aclanthology.org/2023.emnlp-main.142
DOI:
10.18653/v1/2023.emnlp-main.142
Bibkey:
Cite (ACL):
Aniket Pramanick, Yufang Hou, Saif Mohammad, and Iryna Gurevych. 2023. A Diachronic Analysis of Paradigm Shifts in NLP Research: When, How, and Why?. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 2312–2326, Singapore. Association for Computational Linguistics.
Cite (Informal):
A Diachronic Analysis of Paradigm Shifts in NLP Research: When, How, and Why? (Pramanick et al., EMNLP 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.emnlp-main.142.pdf
Video:
 https://aclanthology.org/2023.emnlp-main.142.mp4