Proceedings of the Second Workshop on Natural Language Generation, Evaluation, and Metrics (GEM)

Proceedings of the Second Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Khyathi Chandu editor Kaustubh Dhole editor Varun Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Jekaterina Novikova editor Laura Perez-Beltrachini editor 2022-12 Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) text conference publication gem-2022-natural 10.18653/v1/2022.gem-1.0 https://aclanthology.org/2022.gem-1.0/ Improving abstractive summarization with energy-based re-ranking Diogo Pernes author Afonso Mendes author André F T Martins author 2022-12 text Proceedings of the Second Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Khyathi Chandu editor Kaustubh Dhole editor Varun Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Jekaterina Novikova editor Laura Perez-Beltrachini editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication pernes-etal-2022-improving 10.18653/v1/2022.gem-1.1 https://aclanthology.org/2022.gem-1.1/ 2022-12 1 17 Task-driven augmented data evaluation Olga Golovneva author Pan Wei author Khadige Abboud author Charith Peris author Lizhen Tan author Haiyang Yu author 2022-12 text Proceedings of the Second Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Khyathi Chandu editor Kaustubh Dhole editor Varun Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Jekaterina Novikova editor Laura Perez-Beltrachini editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication golovneva-etal-2022-task 10.18653/v1/2022.gem-1.2 https://aclanthology.org/2022.gem-1.2/ 2022-12 18 25 Generating Coherent Narratives with Subtopic Planning to Answer How-to Questions Pengshan Cai author Mo Yu author Fei Liu author Hong Yu author 2022-12 text Proceedings of the Second Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Khyathi Chandu editor Kaustubh Dhole editor Varun Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Jekaterina Novikova editor Laura Perez-Beltrachini editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication cai-etal-2022-generating 10.18653/v1/2022.gem-1.3 https://aclanthology.org/2022.gem-1.3/ 2022-12 26 42 Weakly Supervised Context-based Interview Question Generation Samiran Pal author Kaamraan Khan author Avinash Kumar Singh author Subhasish Ghosh author Tapas Nayak author Girish Palshikar author Indrajit Bhattacharya author 2022-12 text Proceedings of the Second Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Khyathi Chandu editor Kaustubh Dhole editor Varun Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Jekaterina Novikova editor Laura Perez-Beltrachini editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication pal-etal-2022-weakly 10.18653/v1/2022.gem-1.4 https://aclanthology.org/2022.gem-1.4/ 2022-12 43 53 Analyzing Multi-Task Learning for Abstractive Text Summarization Frederic Thomas Kirstein author Jan Philip Wahle author Terry Ruas author Bela Gipp author 2022-12 text Proceedings of the Second Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Khyathi Chandu editor Kaustubh Dhole editor Varun Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Jekaterina Novikova editor Laura Perez-Beltrachini editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication kirstein-etal-2022-analyzing 10.18653/v1/2022.gem-1.5 https://aclanthology.org/2022.gem-1.5/ 2022-12 54 77 CLSE: Corpus of Linguistically Significant Entities Aleksandr Chuklin author Justin Zhao author Mihir Kale author 2022-12 text Proceedings of the Second Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Khyathi Chandu editor Kaustubh Dhole editor Varun Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Jekaterina Novikova editor Laura Perez-Beltrachini editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication chuklin-etal-2022-clse 10.18653/v1/2022.gem-1.6 https://aclanthology.org/2022.gem-1.6/ 2022-12 78 96 Revisiting text decomposition methods for NLI-based factuality scoring of summaries John Glover author Federico Fancellu author Vasudevan Jagannathan author Matthew R Gormley author Thomas Schaaf author 2022-12 text Proceedings of the Second Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Khyathi Chandu editor Kaustubh Dhole editor Varun Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Jekaterina Novikova editor Laura Perez-Beltrachini editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication glover-etal-2022-revisiting 10.18653/v1/2022.gem-1.7 https://aclanthology.org/2022.gem-1.7/ 2022-12 97 105 Semantic Similarity as a Window into Vector- and Graph-Based Metrics Wai Ching Leung author Shira Wein author Nathan Schneider author 2022-12 text Proceedings of the Second Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Khyathi Chandu editor Kaustubh Dhole editor Varun Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Jekaterina Novikova editor Laura Perez-Beltrachini editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication leung-etal-2022-semantic 10.18653/v1/2022.gem-1.8 https://aclanthology.org/2022.gem-1.8/ 2022-12 106 115 Towards In-Context Non-Expert Evaluation of Reflection Generation for Counselling Conversations Zixiu Wu author Simone Balloccu author Rim Helaoui author Diego Reforgiato Recupero author Daniele Riboni author 2022-12 text Proceedings of the Second Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Khyathi Chandu editor Kaustubh Dhole editor Varun Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Jekaterina Novikova editor Laura Perez-Beltrachini editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication wu-etal-2022-towards-context 10.18653/v1/2022.gem-1.9 https://aclanthology.org/2022.gem-1.9/ 2022-12 116 124 WikiOmnia: filtration and evaluation of the generated QA corpus on the whole Russian Wikipedia Dina Pisarevskaya author Tatiana Shavrina author 2022-12 text Proceedings of the Second Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Khyathi Chandu editor Kaustubh Dhole editor Varun Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Jekaterina Novikova editor Laura Perez-Beltrachini editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication pisarevskaya-shavrina-2022-wikiomnia 10.18653/v1/2022.gem-1.10 https://aclanthology.org/2022.gem-1.10/ 2022-12 125 135 Evaluation of Response Generation Models: Shouldn’t It Be Shareable and Replicable? Seyed Mahed Mousavi author Gabriel Roccabruna author Michela Lorandi author Simone Caldarella author Giuseppe Riccardi author 2022-12 text Proceedings of the Second Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Khyathi Chandu editor Kaustubh Dhole editor Varun Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Jekaterina Novikova editor Laura Perez-Beltrachini editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication mousavi-etal-2022-evaluation 10.18653/v1/2022.gem-1.12 https://aclanthology.org/2022.gem-1.12/ 2022-12 136 147 Enhancing and Evaluating the Grammatical Framework Approach to Logic-to-Text Generation Eduardo Calò author Elze van der Werf author Albert Gatt author Kees van Deemter author 2022-12 text Proceedings of the Second Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Khyathi Chandu editor Kaustubh Dhole editor Varun Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Jekaterina Novikova editor Laura Perez-Beltrachini editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication calo-etal-2022-enhancing 10.18653/v1/2022.gem-1.13 https://aclanthology.org/2022.gem-1.13/ 2022-12 148 171 Controllable Text Generation for All Ages: Evaluating a Plug-and-Play Approach to Age-Adapted Dialogue Lennert Jansen author Štěpán Lars Laichter author Arabella Sinclair author Margot van der Goot author Raquel Fernandez author Sandro Pezzelle author 2022-12 text Proceedings of the Second Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Khyathi Chandu editor Kaustubh Dhole editor Varun Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Jekaterina Novikova editor Laura Perez-Beltrachini editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication jansen-etal-2022-controllable 10.18653/v1/2022.gem-1.14 https://aclanthology.org/2022.gem-1.14/ 2022-12 172 188 Template-based Contact Email Generation for Job Recommendation Qiuchi Li author Christina Lioma author 2022-12 text Proceedings of the Second Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Khyathi Chandu editor Kaustubh Dhole editor Varun Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Jekaterina Novikova editor Laura Perez-Beltrachini editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication li-lioma-2022-template 10.18653/v1/2022.gem-1.15 https://aclanthology.org/2022.gem-1.15/ 2022-12 189 197 Are Abstractive Summarization Models truly ‘Abstractive’? An Empirical Study to Compare the two Forms of Summarization Vinayshekhar Bannihatti Kumar author Rashmi Gangadharaiah author 2022-12 text Proceedings of the Second Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Khyathi Chandu editor Kaustubh Dhole editor Varun Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Jekaterina Novikova editor Laura Perez-Beltrachini editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication kumar-gangadharaiah-2022-abstractive 10.18653/v1/2022.gem-1.17 https://aclanthology.org/2022.gem-1.17/ 2022-12 198 206 Transfer learning for multilingual vacancy text generation Anna Lorincz author David Graus author Dor Lavi author Joao Lebre Magalhaes Pereira author 2022-12 text Proceedings of the Second Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Khyathi Chandu editor Kaustubh Dhole editor Varun Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Jekaterina Novikova editor Laura Perez-Beltrachini editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication lorincz-etal-2022-transfer 10.18653/v1/2022.gem-1.18 https://aclanthology.org/2022.gem-1.18/ 2022-12 207 222 Plug-and-Play Recipe Generation with Content Planning Yinhong Liu author Yixuan Su author Ehsan Shareghi author Nigel Collier author 2022-12 text Proceedings of the Second Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Khyathi Chandu editor Kaustubh Dhole editor Varun Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Jekaterina Novikova editor Laura Perez-Beltrachini editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication liu-etal-2022-plug 10.18653/v1/2022.gem-1.19 https://aclanthology.org/2022.gem-1.19/ 2022-12 223 234 Towards Attribute-Entangled Controllable Text Generation: A Pilot Study of Blessing Generation Shulin Huang author Shirong Ma author Yinghui Li author Li Yangning author Shiyang Lin author Haitao Zheng author Ying Shen author 2022-12 text Proceedings of the Second Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Khyathi Chandu editor Kaustubh Dhole editor Varun Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Jekaterina Novikova editor Laura Perez-Beltrachini editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication huang-etal-2022-towards 10.18653/v1/2022.gem-1.20 https://aclanthology.org/2022.gem-1.20/ 2022-12 235 247 Unsupervised Token-level Hallucination Detection from Summary Generation By-products Andreas Marfurt author James Henderson author 2022-12 text Proceedings of the Second Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Khyathi Chandu editor Kaustubh Dhole editor Varun Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Jekaterina Novikova editor Laura Perez-Beltrachini editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication marfurt-henderson-2022-unsupervised 10.18653/v1/2022.gem-1.21 https://aclanthology.org/2022.gem-1.21/ 2022-12 248 261 A Corpus and Evaluation for Predicting Semi-Structured Human Annotations Andreas Marfurt author Ashley Thornton author David Sylvan author Lonneke van der Plas author James Henderson author 2022-12 text Proceedings of the Second Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Khyathi Chandu editor Kaustubh Dhole editor Varun Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Jekaterina Novikova editor Laura Perez-Beltrachini editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication marfurt-etal-2022-corpus 10.18653/v1/2022.gem-1.22 https://aclanthology.org/2022.gem-1.22/ 2022-12 262 275 T5QL: Taming language models for SQL generation Samuel David Arcadinho author David Aparicio author Hugo Veiga author Antonio Alegria author 2022-12 text Proceedings of the Second Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Khyathi Chandu editor Kaustubh Dhole editor Varun Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Jekaterina Novikova editor Laura Perez-Beltrachini editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication arcadinho-etal-2022-t5ql 10.18653/v1/2022.gem-1.23 https://aclanthology.org/2022.gem-1.23/ 2022-12 276 286 Human perceiving behavior modeling in evaluation of code generation models Sergey Kovalchuk author Vadim Lomshakov author Artem Aliev author 2022-12 text Proceedings of the Second Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Khyathi Chandu editor Kaustubh Dhole editor Varun Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Jekaterina Novikova editor Laura Perez-Beltrachini editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication kovalchuk-etal-2022-human 10.18653/v1/2022.gem-1.24 https://aclanthology.org/2022.gem-1.24/ 2022-12 287 294 Nearest Neighbor Language Models for Stylistic Controllable Generation Severino Trotta author Lucie Flek author Charles Welch author 2022-12 text Proceedings of the Second Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Khyathi Chandu editor Kaustubh Dhole editor Varun Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Jekaterina Novikova editor Laura Perez-Beltrachini editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication trotta-etal-2022-nearest 10.18653/v1/2022.gem-1.25 https://aclanthology.org/2022.gem-1.25/ 2022-12 295 305 On reporting scores and agreement for error annotation tasks Maja Popović author Anya Belz author 2022-12 text Proceedings of the Second Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Khyathi Chandu editor Kaustubh Dhole editor Varun Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Jekaterina Novikova editor Laura Perez-Beltrachini editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication popovic-belz-2022-reporting 10.18653/v1/2022.gem-1.26 https://aclanthology.org/2022.gem-1.26/ 2022-12 306 315 Answerability: A custom metric for evaluating chatbot performance Pranav Gupta author Anand A Rajasekar author Amisha Patel author Mandar Kulkarni author Alexander Sunell author Kyung Kim author Krishnan Ganapathy author Anusua Trivedi author 2022-12 text Proceedings of the Second Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Khyathi Chandu editor Kaustubh Dhole editor Varun Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Jekaterina Novikova editor Laura Perez-Beltrachini editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication gupta-etal-2022-answerability 10.18653/v1/2022.gem-1.27 https://aclanthology.org/2022.gem-1.27/ 2022-12 316 325 Improved Evaluation of Automatic Source Code Summarisation Jesse Phillips author David Bowes author Mahmoud El-Haj author Tracy Hall author 2022-12 text Proceedings of the Second Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Khyathi Chandu editor Kaustubh Dhole editor Varun Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Jekaterina Novikova editor Laura Perez-Beltrachini editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication phillips-etal-2022-improved 10.18653/v1/2022.gem-1.28 https://aclanthology.org/2022.gem-1.28/ 2022-12 326 335 Most NLG is Low-Resource: here’s what we can do about it David M Howcroft author Dimitra Gkatzia author 2022-12 text Proceedings of the Second Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Khyathi Chandu editor Kaustubh Dhole editor Varun Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Jekaterina Novikova editor Laura Perez-Beltrachini editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication howcroft-gkatzia-2022-nlg 10.18653/v1/2022.gem-1.29 https://aclanthology.org/2022.gem-1.29/ 2022-12 336 350 GiCCS: A German in-Context Conversational Similarity Benchmark Shima Asaadi author Zahra Kolagar author Alina Liebel author Alessandra Zarcone author 2022-12 text Proceedings of the Second Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Khyathi Chandu editor Kaustubh Dhole editor Varun Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Jekaterina Novikova editor Laura Perez-Beltrachini editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication asaadi-etal-2022-giccs 10.18653/v1/2022.gem-1.30 https://aclanthology.org/2022.gem-1.30/ 2022-12 351 362 Control Prefixes for Parameter-Efficient Text Generation Jordan Clive author Kris Cao author Marek Rei author 2022-12 text Proceedings of the Second Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Khyathi Chandu editor Kaustubh Dhole editor Varun Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Jekaterina Novikova editor Laura Perez-Beltrachini editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication clive-etal-2022-control 10.18653/v1/2022.gem-1.31 https://aclanthology.org/2022.gem-1.31/ 2022-12 363 382 A Survey of Recent Error Annotation Schemes for Automatically Generated Text Rudali Huidrom author Anya Belz author 2022-12 text Proceedings of the Second Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Khyathi Chandu editor Kaustubh Dhole editor Varun Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Jekaterina Novikova editor Laura Perez-Beltrachini editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication huidrom-belz-2022-survey 10.18653/v1/2022.gem-1.33 https://aclanthology.org/2022.gem-1.33/ 2022-12 383 398 What’s in a (dataset’s) name? The case of BigPatent Silvia Casola author Alberto Lavelli author Horacio Saggion author 2022-12 text Proceedings of the Second Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Khyathi Chandu editor Kaustubh Dhole editor Varun Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Jekaterina Novikova editor Laura Perez-Beltrachini editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication casola-etal-2022-whats 10.18653/v1/2022.gem-1.34 https://aclanthology.org/2022.gem-1.34/ 2022-12 399 404 Measuring the Measuring Tools: An Automatic Evaluation of Semantic Metrics for Text Corpora George Kour author Samuel Ackerman author Eitan Daniel Farchi author Orna Raz author Boaz Carmeli author Ateret Anaby Tavor author 2022-12 text Proceedings of the Second Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Khyathi Chandu editor Kaustubh Dhole editor Varun Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Jekaterina Novikova editor Laura Perez-Beltrachini editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication kour-etal-2022-measuring 10.18653/v1/2022.gem-1.35 https://aclanthology.org/2022.gem-1.35/ 2022-12 405 416 Multilingual Social Media Text Generation and Evaluation with Few-Shot Prompting Mack Blackburn author 2022-12 text Proceedings of the Second Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Khyathi Chandu editor Kaustubh Dhole editor Varun Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Jekaterina Novikova editor Laura Perez-Beltrachini editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication blackburn-2022-multilingual 10.18653/v1/2022.gem-1.39 https://aclanthology.org/2022.gem-1.39/ 2022-12 417 427 Assessing Inter-metric Correlation for Multi-document Summarization Evaluation Michael Ridenour author Ameeta Agrawal author Olubusayo Olabisi author 2022-12 text Proceedings of the Second Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Khyathi Chandu editor Kaustubh Dhole editor Varun Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Jekaterina Novikova editor Laura Perez-Beltrachini editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication ridenour-etal-2022-assessing 10.18653/v1/2022.gem-1.40 https://aclanthology.org/2022.gem-1.40/ 2022-12 428 438 Factual Error Correction for Abstractive Summaries Using Entity Retrieval Hwanhee Lee author Cheoneum Park author Seunghyun Yoon author Trung Bui author Franck Dernoncourt author Juae Kim author Kyomin Jung author 2022-12 text Proceedings of the Second Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Khyathi Chandu editor Kaustubh Dhole editor Varun Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Jekaterina Novikova editor Laura Perez-Beltrachini editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication lee-etal-2022-factual 10.18653/v1/2022.gem-1.41 https://aclanthology.org/2022.gem-1.41/ 2022-12 439 444 Coherent Long Text Generation by Contrastive Soft Prompt Guandan Chen author Jiashu Pu author Yadong Xi author Rongsheng Zhang author 2022-12 text Proceedings of the Second Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Khyathi Chandu editor Kaustubh Dhole editor Varun Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Jekaterina Novikova editor Laura Perez-Beltrachini editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication chen-etal-2022-coherent 10.18653/v1/2022.gem-1.42 https://aclanthology.org/2022.gem-1.42/ 2022-12 445 455 Error Analysis of ToTTo Table-to-Text Neural NLG Models Barkavi Sundararajan author Somayajulu Sripada author Ehud Reiter author 2022-12 text Proceedings of the Second Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Khyathi Chandu editor Kaustubh Dhole editor Varun Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Jekaterina Novikova editor Laura Perez-Beltrachini editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication sundararajan-etal-2022-error 10.18653/v1/2022.gem-1.43 https://aclanthology.org/2022.gem-1.43/ 2022-12 456 470 Improving Dialogue Act Recognition with Augmented Data Khyati Mahajan author Soham Parikh author Quaizar Vohra author Mitul Tiwari author Samira Shaikh author 2022-12 text Proceedings of the Second Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Khyathi Chandu editor Kaustubh Dhole editor Varun Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Jekaterina Novikova editor Laura Perez-Beltrachini editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication mahajan-etal-2022-improving 10.18653/v1/2022.gem-1.44 https://aclanthology.org/2022.gem-1.44/ 2022-12 471 479 Do Decoding Algorithms Capture Discourse Structure in Multi-Modal Tasks? A Case Study of Image Paragraph Generation Nikolai Ilinykh author Simon Dobnik author 2022-12 text Proceedings of the Second Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Khyathi Chandu editor Kaustubh Dhole editor Varun Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Jekaterina Novikova editor Laura Perez-Beltrachini editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication ilinykh-dobnik-2022-decoding 10.18653/v1/2022.gem-1.45 https://aclanthology.org/2022.gem-1.45/ 2022-12 480 493 20Q: Overlap-Free World Knowledge Benchmark for Language Models Maxime De Bruyn author Ehsan Lotfi author Jeska Buhmann author Walter Daelemans author 2022-12 text Proceedings of the Second Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Khyathi Chandu editor Kaustubh Dhole editor Varun Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Jekaterina Novikova editor Laura Perez-Beltrachini editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication de-bruyn-etal-2022-20q 10.18653/v1/2022.gem-1.46 https://aclanthology.org/2022.gem-1.46/ 2022-12 494 508 What Was Your Name Again? Interrogating Generative Conversational Models For Factual Consistency Evaluation Ehsan Lotfi author Maxime De Bruyn author Jeska Buhmann author Walter Daelemans author 2022-12 text Proceedings of the Second Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Khyathi Chandu editor Kaustubh Dhole editor Varun Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Jekaterina Novikova editor Laura Perez-Beltrachini editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication lotfi-etal-2022-name 10.18653/v1/2022.gem-1.47 https://aclanthology.org/2022.gem-1.47/ 2022-12 509 519 Narrative Why-Question Answering: A Review of Challenges and Datasets Emil Kalbaliyev author Kairit Sirts author 2022-12 text Proceedings of the Second Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Khyathi Chandu editor Kaustubh Dhole editor Varun Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Jekaterina Novikova editor Laura Perez-Beltrachini editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication kalbaliyev-sirts-2022-narrative 10.18653/v1/2022.gem-1.48 https://aclanthology.org/2022.gem-1.48/ 2022-12 520 530 Exploring a POS-based Two-stage Approach for Improving Low-Resource AMR-to-Text Generation Marco Antonio Sobrevilla Cabezudo author Thiago Pardo author 2022-12 text Proceedings of the Second Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Khyathi Chandu editor Kaustubh Dhole editor Varun Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Jekaterina Novikova editor Laura Perez-Beltrachini editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication sobrevilla-cabezudo-pardo-2022-exploring 10.18653/v1/2022.gem-1.49 https://aclanthology.org/2022.gem-1.49/ 2022-12 531 538 What Makes Data-to-Text Generation Hard for Pretrained Language Models? Moniba Keymanesh author Adrian Benton author Mark Dredze author 2022-12 text Proceedings of the Second Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Khyathi Chandu editor Kaustubh Dhole editor Varun Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Jekaterina Novikova editor Laura Perez-Beltrachini editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication keymanesh-etal-2022-makes 10.18653/v1/2022.gem-1.50 https://aclanthology.org/2022.gem-1.50/ 2022-12 539 554 Don’t Say What You Don’t Know: Improving the Consistency of Abstractive Summarization by Constraining Beam Search Daniel King author Zejiang Shen author Nishant Subramani author Daniel S Weld author Iz Beltagy author Doug Downey author 2022-12 text Proceedings of the Second Workshop on Natural Language Generation, Evaluation, and Metrics (GEM) Antoine Bosselut editor Khyathi Chandu editor Kaustubh Dhole editor Varun Gangal editor Sebastian Gehrmann editor Yacine Jernite editor Jekaterina Novikova editor Laura Perez-Beltrachini editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication king-etal-2022-dont 10.18653/v1/2022.gem-1.51 https://aclanthology.org/2022.gem-1.51/ 2022-12 555 571