Shoulders of Giants: A Look at the Degree and Utility of Openness in NLP Research

Surangika Ranathunga, Nisansa De Silva, Dilith Jayakody, Aloka Fernando


Abstract
We analysed a sample of NLP research papers archived in ACL Anthology as an attempt to quantify the degree of openness and the benefit of such an open culture in the NLP community. We observe that papers published in different NLP venues show different patterns related to artefact reuse. We also note that more than 30% of the papers we analysed do not release their artefacts publicly. Further, we observe a wide language-wise disparity in publicly available NLP-related artefacts.
Anthology ID:
2024.acl-short.48
Volume:
Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)
Month:
August
Year:
2024
Address:
Bangkok, Thailand
Editors:
Lun-Wei Ku, Andre Martins, Vivek Srikumar
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
519–529
Language:
URL:
https://aclanthology.org/2024.acl-short.48
DOI:
Bibkey:
Cite (ACL):
Surangika Ranathunga, Nisansa De Silva, Dilith Jayakody, and Aloka Fernando. 2024. Shoulders of Giants: A Look at the Degree and Utility of Openness in NLP Research. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pages 519–529, Bangkok, Thailand. Association for Computational Linguistics.
Cite (Informal):
Shoulders of Giants: A Look at the Degree and Utility of Openness in NLP Research (Ranathunga et al., ACL 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.acl-short.48.pdf