Proceedings of the First Workshop on Natural Language Generation, Evaluation, and Metrics (GEM)

Proceedings of the First Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Esin Durmus editor Varun Prashant Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Laura Perez-Beltrachini editor Samira Shaikh editor Wei Xu editor 2021-08 Association for Computational Linguistics Online text conference publication gem-2021-natural https://aclanthology.org/2021.gem-1.0/ Flesch-Kincaid is Not a Text Simplification Evaluation Metric Teerapaun Tanprasert author David Kauchak author 2021-08 text Proceedings of the First Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Esin Durmus editor Varun Prashant Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Laura Perez-Beltrachini editor Samira Shaikh editor Wei Xu editor Association for Computational Linguistics Online conference publication tanprasert-kauchak-2021-flesch 10.18653/v1/2021.gem-1.1 https://aclanthology.org/2021.gem-1.1/ 2021-08 1 14 Human Perception in Natural Language Generation Lorenzo De Mattei author Huiyuan Lai author Felice Dell’Orletta author Malvina Nissim author 2021-08 text Proceedings of the First Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Esin Durmus editor Varun Prashant Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Laura Perez-Beltrachini editor Samira Shaikh editor Wei Xu editor Association for Computational Linguistics Online conference publication de-mattei-etal-2021-human 10.18653/v1/2021.gem-1.2 https://aclanthology.org/2021.gem-1.2/ 2021-08 15 23 Semantic Similarity Based Evaluation for Abstractive News Summarization Figen Beken Fikri author Kemal Oflazer author Berrin Yanikoglu author 2021-08 text Proceedings of the First Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Esin Durmus editor Varun Prashant Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Laura Perez-Beltrachini editor Samira Shaikh editor Wei Xu editor Association for Computational Linguistics Online conference publication beken-fikri-etal-2021-semantic 10.18653/v1/2021.gem-1.3 https://aclanthology.org/2021.gem-1.3/ 2021-08 24 33 Shades of BLEU, Flavours of Success: The Case of MultiWOZ Tomáš Nekvinda author Ondřej Dušek author 2021-08 text Proceedings of the First Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Esin Durmus editor Varun Prashant Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Laura Perez-Beltrachini editor Samira Shaikh editor Wei Xu editor Association for Computational Linguistics Online conference publication nekvinda-dusek-2021-shades 10.18653/v1/2021.gem-1.4 https://aclanthology.org/2021.gem-1.4/ 2021-08 34 46 Personalized Response Generation with Tensor Factorization Zhenghui Wang author Lingxiao Luo author Diyi Yang author 2021-08 text Proceedings of the First Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Esin Durmus editor Varun Prashant Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Laura Perez-Beltrachini editor Samira Shaikh editor Wei Xu editor Association for Computational Linguistics Online conference publication wang-etal-2021-personalized 10.18653/v1/2021.gem-1.5 https://aclanthology.org/2021.gem-1.5/ 2021-08 47 57 A Review of Human Evaluation for Style Transfer Eleftheria Briakou author Sweta Agrawal author Ke Zhang author Joel Tetreault author Marine Carpuat author 2021-08 text Proceedings of the First Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Esin Durmus editor Varun Prashant Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Laura Perez-Beltrachini editor Samira Shaikh editor Wei Xu editor Association for Computational Linguistics Online conference publication briakou-etal-2021-review 10.18653/v1/2021.gem-1.6 https://aclanthology.org/2021.gem-1.6/ 2021-08 58 67 GOT: Testing for Originality in Natural Language Generation Jennifer Brooks author Abdou Youssef author 2021-08 text Proceedings of the First Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Esin Durmus editor Varun Prashant Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Laura Perez-Beltrachini editor Samira Shaikh editor Wei Xu editor Association for Computational Linguistics Online conference publication brooks-youssef-2021-got 10.18653/v1/2021.gem-1.7 https://aclanthology.org/2021.gem-1.7/ 2021-08 68 72 Evaluating Text Generation from Discourse Representation Structures Chunliu Wang author Rik van Noord author Arianna Bisazza author Johan Bos author 2021-08 text Proceedings of the First Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Esin Durmus editor Varun Prashant Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Laura Perez-Beltrachini editor Samira Shaikh editor Wei Xu editor Association for Computational Linguistics Online conference publication wang-etal-2021-evaluating 10.18653/v1/2021.gem-1.8 https://aclanthology.org/2021.gem-1.8/ 2021-08 73 83 Human Evaluation of Creative NLG Systems: An Interdisciplinary Survey on Recent Papers Mika Hämäläinen author Khalid Alnajjar author 2021-08 text Proceedings of the First Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Esin Durmus editor Varun Prashant Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Laura Perez-Beltrachini editor Samira Shaikh editor Wei Xu editor Association for Computational Linguistics Online conference publication hamalainen-alnajjar-2021-human 10.18653/v1/2021.gem-1.9 https://aclanthology.org/2021.gem-1.9/ 2021-08 84 95 The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics Sebastian Gehrmann author Tosin Adewumi author Karmanya Aggarwal author Pawan Sasanka Ammanamanchi author Anuoluwapo Aremu author Antoine Bosselut author Khyathi Raghavi Chandu author Miruna-Adriana Clinciu author Dipanjan Das author Kaustubh Dhole author Wanyu Du author Esin Durmus author Ondřej Dušek author Chris Chinenye Emezue author Varun Gangal author Cristina Garbacea author Tatsunori Hashimoto author Yufang Hou author Yacine Jernite author Harsh Jhamtani author Yangfeng Ji author Shailza Jolly author Mihir Kale author Dhruv Kumar author Faisal Ladhak author Aman Madaan author Mounica Maddela author Khyati Mahajan author Saad Mahamood author Bodhisattwa Prasad Majumder author Pedro Henrique Martins author Angelina McMillan-Major author Simon Mille author Emiel van Miltenburg author Moin Nadeem author Shashi Narayan author Vitaly Nikolaev author Andre Niyongabo Rubungo author Salomey Osei author Ankur Parikh author Laura Perez-Beltrachini author Niranjan Ramesh Rao author Vikas Raunak author Juan Diego Rodriguez author Sashank Santhanam author João Sedoc author Thibault Sellam author Samira Shaikh author Anastasia Shimorina author Marco Antonio Sobrevilla Cabezudo author Hendrik Strobelt author Nishant Subramani author Wei Xu author Diyi Yang author Akhila Yerukola author Jiawei Zhou author 2021-08 text Proceedings of the First Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Esin Durmus editor Varun Prashant Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Laura Perez-Beltrachini editor Samira Shaikh editor Wei Xu editor Association for Computational Linguistics Online conference publication gehrmann-etal-2021-gem 10.18653/v1/2021.gem-1.10 https://aclanthology.org/2021.gem-1.10/ 2021-08 96 120 Reusable Templates and Guides For Documenting Datasets and Models for Natural Language Processing and Generation: A Case Study of the HuggingFace and GEM Data and Model Cards Angelina McMillan-Major author Salomey Osei author Juan Diego Rodriguez author Pawan Sasanka Ammanamanchi author Sebastian Gehrmann author Yacine Jernite author 2021-08 text Proceedings of the First Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Esin Durmus editor Varun Prashant Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Laura Perez-Beltrachini editor Samira Shaikh editor Wei Xu editor Association for Computational Linguistics Online conference publication mcmillan-major-etal-2021-reusable 10.18653/v1/2021.gem-1.11 https://aclanthology.org/2021.gem-1.11/ 2021-08 121 135 Structure-to-Text Generation with Self-Training, Acceptability Classifiers and Context-Conditioning for the GEM Shared Task Shreyan Bakshi author Soumya Batra author Peyman Heidari author Ankit Arun author Shashank Jain author Michael White author 2021-08 text Proceedings of the First Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Esin Durmus editor Varun Prashant Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Laura Perez-Beltrachini editor Samira Shaikh editor Wei Xu editor Association for Computational Linguistics Online conference publication bakshi-etal-2021-structure 10.18653/v1/2021.gem-1.12 https://aclanthology.org/2021.gem-1.12/ 2021-08 136 147 NUIG-DSI’s submission to The GEM Benchmark 2021 Nivranshu Pasricha author Mihael Arcan author Paul Buitelaar author 2021-08 text Proceedings of the First Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Esin Durmus editor Varun Prashant Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Laura Perez-Beltrachini editor Samira Shaikh editor Wei Xu editor Association for Computational Linguistics Online conference publication pasricha-etal-2021-nuig 10.18653/v1/2021.gem-1.13 https://aclanthology.org/2021.gem-1.13/ 2021-08 148 154 SimpleNER Sentence Simplification System for GEM 2021 K V Aditya Srivatsa author Monil Gokani author Manish Shrivastava author 2021-08 text Proceedings of the First Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Esin Durmus editor Varun Prashant Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Laura Perez-Beltrachini editor Samira Shaikh editor Wei Xu editor Association for Computational Linguistics Online conference publication srivatsa-etal-2021-simplener 10.18653/v1/2021.gem-1.14 https://aclanthology.org/2021.gem-1.14/ 2021-08 155 160 System Description for the CommonGen task with the POINTER model Anna Shvets author 2021-08 text Proceedings of the First Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Esin Durmus editor Varun Prashant Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Laura Perez-Beltrachini editor Samira Shaikh editor Wei Xu editor Association for Computational Linguistics Online conference publication shvets-2021-system 10.18653/v1/2021.gem-1.15 https://aclanthology.org/2021.gem-1.15/ 2021-08 161 165 Decoding Methods for Neural Narrative Generation Alexandra DeLucia author Aaron Mueller author Xiang Lisa Li author João Sedoc author 2021-08 text Proceedings of the First Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Esin Durmus editor Varun Prashant Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Laura Perez-Beltrachini editor Samira Shaikh editor Wei Xu editor Association for Computational Linguistics Online conference publication delucia-etal-2021-decoding 10.18653/v1/2021.gem-1.16 https://aclanthology.org/2021.gem-1.16/ 2021-08 166 185