The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics Sebastian Gehrmann author Tosin Adewumi author Karmanya Aggarwal author Pawan Sasanka Ammanamanchi author Anuoluwapo Aremu author Antoine Bosselut author Khyathi Raghavi Chandu author Miruna-Adriana Clinciu author Dipanjan Das author Kaustubh Dhole author Wanyu Du author Esin Durmus author Ondřej Dušek author Chris Chinenye Emezue author Varun Gangal author Cristina Garbacea author Tatsunori Hashimoto author Yufang Hou author Yacine Jernite author Harsh Jhamtani author Yangfeng Ji author Shailza Jolly author Mihir Kale author Dhruv Kumar author Faisal Ladhak author Aman Madaan author Mounica Maddela author Khyati Mahajan author Saad Mahamood author Bodhisattwa Prasad Majumder author Pedro Henrique Martins author Angelina McMillan-Major author Simon Mille author Emiel van Miltenburg author Moin Nadeem author Shashi Narayan author Vitaly Nikolaev author Andre Niyongabo Rubungo author Salomey Osei author Ankur Parikh author Laura Perez-Beltrachini author Niranjan Ramesh Rao author Vikas Raunak author Juan Diego Rodriguez author Sashank Santhanam author João Sedoc author Thibault Sellam author Samira Shaikh author Anastasia Shimorina author Marco Antonio Sobrevilla Cabezudo author Hendrik Strobelt author Nishant Subramani author Wei Xu author Diyi Yang author Akhila Yerukola author Jiawei Zhou author 2021-08 text Proceedings of the First Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Esin Durmus editor Varun Prashant Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Laura Perez-Beltrachini editor Samira Shaikh editor Wei Xu editor Association for Computational Linguistics Online conference publication gehrmann-etal-2021-gem 10.18653/v1/2021.gem-1.10 https://aclanthology.org/2021.gem-1.10/ 2021-08 96 120