Hyperparameter Power Impact in Transformer Language Model Training Lucas Høyberg Puvis de Chavannes author Mads Guldborg Kjeldgaard Kongsbak author Timmie Rantzau author Leon Derczynski author 2021-11 text Proceedings of the Second Workshop on Simple and Efficient Natural Language Processing Nafise Sadat Moosavi editor Iryna Gurevych editor Angela Fan editor Thomas Wolf editor Yufang Hou editor Ana Marasović editor Sujith Ravi editor Association for Computational Linguistics Virtual conference publication puvis-de-chavannes-etal-2021-hyperparameter 10.18653/v1/2021.sustainlp-1.12 https://aclanthology.org/2021.sustainlp-1.12/ 2021-11 96 118