GPT-NeoX-20B: An Open-Source Autoregressive Language Model Sidney Black author Stella Biderman author Eric Hallahan author Quentin Anthony author Leo Gao author Laurence Golding author Horace He author Connor Leahy author Kyle McDonell author Jason Phang author Michael Pieler author Usvsn Sai Prashanth author Shivanshu Purohit author Laria Reynolds author Jonathan Tow author Ben Wang author Samuel Weinbach author 2022-05 text Proceedings of BigScience Episode #5 – Workshop on Challenges & Perspectives in Creating Large Language Models Angela Fan editor Suzana Ilic editor Thomas Wolf editor Matthias Gallé editor Association for Computational Linguistics virtual+Dublin conference publication black-etal-2022-gpt 10.18653/v1/2022.bigscience-1.9 https://aclanthology.org/2022.bigscience-1.9/ 2022-05 95 136