On “Scientific Debt” in NLP: A Case for More Rigour in Language Model Pre-Training Research Made Nindyatama Nityasya author Haryo Wibowo author Alham Fikri Aji author Genta Winata author Radityo Eko Prasojo author Phil Blunsom author Adhiguna Kuncoro author 2023-07 text Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) Anna Rogers editor Jordan Boyd-Graber editor Naoaki Okazaki editor Association for Computational Linguistics Toronto, Canada conference publication nityasya-etal-2023-scientific 10.18653/v1/2023.acl-long.477 https://aclanthology.org/2023.acl-long.477/ 2023-07 8554 8572