GEMv2: Multilingual NLG Benchmarking in a Single Line of Code Sebastian Gehrmann author Abhik Bhattacharjee author Abinaya Mahendiran author Alex Wang author Alexandros Papangelis author Aman Madaan author Angelina Mcmillan-major author Anna Shvets author Ashish Upadhyay author Bernd Bohnet author Bingsheng Yao author Bryan Wilie author Chandra Bhagavatula author Chaobin You author Craig Thomson author Cristina Garbacea author Dakuo Wang author Daniel Deutsch author Deyi Xiong author Di Jin author Dimitra Gkatzia author Dragomir Radev author Elizabeth Clark author Esin Durmus author Faisal Ladhak author Filip Ginter author Genta Indra Winata author Hendrik Strobelt author Hiroaki Hayashi author Jekaterina Novikova author Jenna Kanerva author Jenny Chim author Jiawei Zhou author Jordan Clive author Joshua Maynez author João Sedoc author Juraj Juraska author Kaustubh Dhole author Khyathi Raghavi Chandu author Laura Perez Beltrachini author Leonardo F . R Ribeiro author Lewis Tunstall author Li Zhang author Mahim Pushkarna author Mathias Creutz author Michael White author Mihir Sanjay Kale author Moussa Kamal Eddine author Nico Daheim author Nishant Subramani author Ondrej Dusek author Paul Pu Liang author Pawan Sasanka Ammanamanchi author Qi Zhu author Ratish Puduppully author Reno Kriz author Rifat Shahriyar author Ronald Cardenas author Saad Mahamood author Salomey Osei author Samuel Cahyawijaya author Sanja Štajner author Sebastien Montella author Shailza Jolly author Simon Mille author Tahmid Hasan author Tianhao Shen author Tosin Adewumi author Vikas Raunak author Vipul Raheja author Vitaly Nikolaev author Vivian Tsai author Yacine Jernite author Ying Xu author Yisi Sang author Yixin Liu author Yufang Hou author 2022-12 text Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing: System Demonstrations Wanxiang Che editor Ekaterina Shutova editor Association for Computational Linguistics Abu Dhabi, UAE conference publication gehrmann-etal-2022-gemv2 10.18653/v1/2022.emnlp-demos.27 https://aclanthology.org/2022.emnlp-demos.27/ 2022-12 266 281