Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM)

Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor 2026-07 Association for Computational Linguistics San Diego, California, USA text conference publication 979-8-89176-423-1 gem-2026-main https://aclanthology.org/2026.gem-main.0/ CoSy: Conversational Synthesis for Grounded Question Answering Patrick Huber author Arash Einolghozati author Rylan Conway author Kanika Narang author Matt Smith author Waqar Nayyar author Adithya Sagar author Ahmed A Aly author Akshat Shrivastava author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 huber-etal-2026-cosy https://aclanthology.org/2026.gem-main.2/ 2026-07 1 10 VAIDYA: Validated Agents for Intelligent Diagnosis and Yielded Analysis Kalash Shah author Gautam Bhutani author Rohitaswa Sarbhangia author J Snehan author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 shah-etal-2026-vaidya https://aclanthology.org/2026.gem-main.3/ 2026-07 11 33 Self-Anchoring Calibration Drift in Large Language Models: How Multi-Turn Conversations Reshape Model Confidence Harshavardhan author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 harshavardhan-2026-self https://aclanthology.org/2026.gem-main.4/ 2026-07 34 40 Temporal Tokenization Strategies for Event Sequence Modeling with Large Language Models Zefang Liu author Nam H Nguyen author Yinzhu Quan author Shi-Xiong Zhang author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 liu-etal-2026-temporal-tokenization https://aclanthology.org/2026.gem-main.5/ 2026-07 41 51 “Be My Cheese?”: Cultural Nuance Benchmarking for Machine Translation in Multilingual LLMs Madison Van Doren author Casey Ford author Jennifer Barajas author Riley VanMeter author Cory Holland author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 van-doren-etal-2026-cheese https://aclanthology.org/2026.gem-main.6/ 2026-07 52 76 Component Transfer Can Exceed Full Model Performance: Investigating Post-Trained Mixture-of-Experts Rabin Tiwari author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 tiwari-2026-component https://aclanthology.org/2026.gem-main.7/ 2026-07 77 83 Reassessing Extractive QA Datasets at Scale: LLM-as-a-Judge and In-Depth Analyses Xanh Ho author Jiahao Huang author Florian Boudin author Akiko Aizawa author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 ho-etal-2026-reassessing https://aclanthology.org/2026.gem-main.9/ 2026-07 84 101 IndicMMLU-Pro: Benchmarking Indic Large Language Models on Multi-Task Language Understanding Sankalp Jajee author Ashutosh Kumar author Nikunj Kotecha author Vinija Jain author Aman Chadha author Sreyoshi Bhaduri author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 jajee-etal-2026-indicmmlu https://aclanthology.org/2026.gem-main.10/ 2026-07 102 111 Identifying Where Large Language Models Struggle in Answering Complex Questions Xanh Ho author Florian Boudin author Saku Sugawara author Khoa Duong author Akiko Aizawa author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 ho-etal-2026-identifying https://aclanthology.org/2026.gem-main.11/ 2026-07 112 123 More Yap Less Meaning: Uncovering Self-Improvement Behavior in SLMs Marina Igitkhanian author Erik Arakelyan author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 igitkhanian-arakelyan-2026-yap https://aclanthology.org/2026.gem-main.12/ 2026-07 124 135 Reinforced Agent: Inference-Time Feedback for Tool-Calling Agents Anh Ta author Junjie Zhu author Shahin Shayandeh author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 ta-etal-2026-reinforced https://aclanthology.org/2026.gem-main.13/ 2026-07 136 147 RE-AD: Real-Time Requirement Adherence for Data Labeling Siddarth Malreddy author Ishan Nigam author Akshay Arora author Nikhil Mittal author Subrat Sahu author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 malreddy-etal-2026-ad https://aclanthology.org/2026.gem-main.17/ 2026-07 148 154 Lost in Space: Finding the Right Tokens for Structured Output Sil Hamilton author David Mimno author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 hamilton-mimno-2026-lost https://aclanthology.org/2026.gem-main.18/ 2026-07 155 166 An Empirical Study of LLM-as-a-Judge: How Design Choices Impact Evaluation Reliability Yusuke Yamauchi author Taro Yano author Masafumi Oyamada author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 yamauchi-etal-2026-empirical https://aclanthology.org/2026.gem-main.19/ 2026-07 167 176 Capturing Epistemic Uncertainty in LLM-Based Soft Labeling Yanru Jiang author Siyu Liang author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 jiang-liang-2026-capturing https://aclanthology.org/2026.gem-main.21/ 2026-07 177 190 Mind the Gap... or Not? How Translation Errors and Evaluation Details Skew Multilingual Results Jan-Thorsten Peter author David Vilar author Tobias Domhan author Dan Malkin author Markus Freitag author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 peter-etal-2026-mind https://aclanthology.org/2026.gem-main.22/ 2026-07 191 204 MCJudgeBench: A Benchmark for Constraint-Level Judge Evaluation in Multi-Constraint Instruction Following Jaeyun Lee author Junyoung Koh author Zeynel Tok author Hunar Batra author Ronald Clark author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 lee-etal-2026-mcjudgebench https://aclanthology.org/2026.gem-main.23/ 2026-07 205 221 MedAct: Removing the Human Bottleneck in Benchmarking Clinical LLM Safety Arjun Krishna author Brian Pridgen author Max Silverstein author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 krishna-etal-2026-medact https://aclanthology.org/2026.gem-main.24/ 2026-07 222 230 Response Content Units: Evaluating Completeness and Proactiveness in Medical Open-Response Question Answering Yongsin Park author Wen-wai Yim author Emma McKibbin author Asma Ben Abacha author Fei Xia author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 park-etal-2026-response https://aclanthology.org/2026.gem-main.25/ 2026-07 231 252 NanoFlux: Adversarial Dual-LLM Evaluation and Distillation for Multi-Domain Reasoning Raviteja Anantha author Soheil Hor author Teodor Nicola Antoniu author Layne C Price author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 anantha-etal-2026-nanoflux https://aclanthology.org/2026.gem-main.27/ 2026-07 253 270 Evaluating the Reliability of LLMs in Faithfully Updating Text: An Empirical Study Ayan Datta author Paheli Bhattacharya author Rishabh Gupta author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 datta-etal-2026-evaluating https://aclanthology.org/2026.gem-main.28/ 2026-07 271 284 Not All Tokens Are Equal: Per-Dimension Top-K Pooling for Adversarially Robust BERT Classification Manoranjan Dash author Shivam Anand Aralikatti author Shanay Sheth author Pranav Shinde author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 dash-etal-2026-tokens https://aclanthology.org/2026.gem-main.29/ 2026-07 285 295 Near-Miss: Latent Policy Failure Detection in Agentic Workflows Ella Rabinovich author David Boaz author Naama Zwerdling author Ateret Anaby Tavor author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 rabinovich-etal-2026-near https://aclanthology.org/2026.gem-main.30/ 2026-07 296 308 Evaluating Counterfactual Strategic Reasoning in Large Language Models Dimitrios Georgousis author Maria Lymperaiou author Angeliki Dimitriou author Giorgos Filandrianos author Giorgos Stamou author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 georgousis-etal-2026-evaluating https://aclanthology.org/2026.gem-main.31/ 2026-07 309 354 Speculative Refinement: A Hybrid Autoregressive Diffusion Decoding Strategy and Its Behavior Across Benchmarks Aditi Gupta author Neel Mishra author Kushagra Trivedi author Pawan Kumar author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 gupta-etal-2026-speculative https://aclanthology.org/2026.gem-main.33/ 2026-07 355 363 SAUCE: Summary Analysis Using Conversation Entailment Man-Ling Sung author Hemanth Kandula author Jeff Ma author William Hartmann author Matthew Snover author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 sung-etal-2026-sauce https://aclanthology.org/2026.gem-main.34/ 2026-07 364 377 Evaluating ASR Quality at Scale on TV Entertainment Platforms Adeep Hande author Kishorekumar Sundararajan author Yidnekachew Endale author Akshatha Bapu KrishnaSwamy author Sachin Dabral author Dawn Reed author Michael Pereira author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 hande-etal-2026-evaluating https://aclanthology.org/2026.gem-main.35/ 2026-07 378 383 Fine-Tuning vs. RAG for Multi-Hop Question Answering with Novel Knowledge Zhuoyi Yang author Yurun Song author Kyler G Harris author Iftekhar Ahmed author Ian Harris author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 yang-etal-2026-fine https://aclanthology.org/2026.gem-main.37/ 2026-07 384 392 MHGraphBench: Knowledge Graph-Grounded Benchmarking of Mental Health Knowledge in Large Language Models Weixin Liu author Congning Ni author Shelagh A Mulvaney author Susannah L Rose author Murat Kantarcioglu author Bradley A Malin author Zhijun Yin author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 liu-etal-2026-mhgraphbench https://aclanthology.org/2026.gem-main.38/ 2026-07 393 409 A Progressive Evaluation Framework for Multicultural Analysis of Story Visualization Janak Kapuriya author Ali Hatami author Paul Buitelaar author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 kapuriya-etal-2026-progressive https://aclanthology.org/2026.gem-main.39/ 2026-07 410 427 Is GraphRAG Needed? From Basic RAG to Graph-/Agentic Solutions with Context Optimization Long Chen author Ryan Razkenari author Yuxuan Zhou author Yuan Tian author Rahul Ghosh author Venkatesh Pappakrishnan author Disha Ahuja author Vidya Sagar Ravipati author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 chen-etal-2026-graphrag https://aclanthology.org/2026.gem-main.40/ 2026-07 428 442 Cross-Domain Semantic Fidelity Evaluation for Meaning-to-Text Generation Davan Harrison author Marilyn Walker author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 harrison-walker-2026-cross https://aclanthology.org/2026.gem-main.41/ 2026-07 443 455 E-star 12B: Reliable Rubric-Following and Domain-Adaptive SLM Evaluator for Korean Industrial Settings Yonghoon Kwon author Heondeuk Lee author Barom Kang author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 kwon-etal-2026-e https://aclanthology.org/2026.gem-main.42/ 2026-07 456 471 Pressure-Testing Deception Probes in LLMs: Scaling, Robustness, and the Geometry of Deceptive Representations Sachin Kumar author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 kumar-2026-pressure https://aclanthology.org/2026.gem-main.43/ 2026-07 472 489 Sycophancy Negatively Affects LLM-as-a-Judge in Conflict Evaluation Naghmeh Farzi author Laura Dietz author Samuel Carton author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 farzi-etal-2026-sycophancy https://aclanthology.org/2026.gem-main.45/ 2026-07 490 501 Concord: An Agreement-Aware Multi-Adjudication Pipeline for LLM Evaluation Tyler Bliss author Mahit Verma author Aila Iyer-Singh author Subrata Biswas author Sheikh Asif Imran author Bashima Islam author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 bliss-etal-2026-concord https://aclanthology.org/2026.gem-main.46/ 2026-07 502 510 The Silent Vote: Improving Zero-Shot LLM Reliability by Aggregating Semantic Neighborhoods Sanket Badhe author Priyanka Tiwari author Deep Shah author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 badhe-etal-2026-silent https://aclanthology.org/2026.gem-main.48/ 2026-07 511 517 Are LLM Benchmarks Already Contaminated? A Systematic Review of Contamination Detection Methods Erfan Nourbakhsh author Mohammad Sadegh Sirjani author Amir Mousavi author Khoa Nguyen author John Quarles author Mimi Xie author Rocky Slavin author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 nourbakhsh-etal-2026-llm https://aclanthology.org/2026.gem-main.50/ 2026-07 518 539 RBCorr: Response Bias Correction in Language Models Om Bhatt author Anna A Ivanova author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 bhatt-ivanova-2026-rbcorr https://aclanthology.org/2026.gem-main.51/ 2026-07 540 553 Exploring Coherence of LLMs in Multilingual Question Answering Stefano Campese author Ivano Lauriola author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 campese-lauriola-2026-exploring https://aclanthology.org/2026.gem-main.52/ 2026-07 554 562 Token Cost Inequality: Measuring Tokenization Disparities Across Scripts in Roman Urdu and Urdu Waleed Jamil author Saima Rafi author Yanchao Yu author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 jamil-etal-2026-token https://aclanthology.org/2026.gem-main.54/ 2026-07 563 573 Semantic vs. Structural Signals: Log-Probability and LLM-as-a-Judge for Reference-Free Code Evaluation Dmitriy Fedrushkov author Yulong He author Ivan Smirnov author Artem Aliev author Sergey Kovalchuk author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 fedrushkov-etal-2026-semantic https://aclanthology.org/2026.gem-main.55/ 2026-07 574 581 Stability vs. Manipulability: Evaluating Robustness Under Post-Decision Interaction in LLM Judges Srimonti Dutta author Akshata Kishore Moharir author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 dutta-moharir-2026-stability https://aclanthology.org/2026.gem-main.57/ 2026-07 582 594 Permutation-Consensus Listwise Judging for Robust Factuality Evaluation Tianyi Huang author Nathan Huang author Justin Tang author Wenqian Chen author Elsa Fan author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 huang-etal-2026-permutation https://aclanthology.org/2026.gem-main.58/ 2026-07 595 603 MedFact: Benchmarking the Fact-Checking Capabilities of Large Language Models on Chinese Medical Texts Jiayi He author Yangmin Huang author Qianyun Du author Xiangying Zhou author Zhiyang He author Jiaxue Hu author Xiaodong Tao author Lixian Lai author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 he-etal-2026-medfact https://aclanthology.org/2026.gem-main.59/ 2026-07 604 652 Early-Token Confidence Predicts Reasoning Quality in Multi-Agent LLM Debate Ali Keramati author Justin Cheok author Jacob Horne author Mark Warschauer author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 keramati-etal-2026-early https://aclanthology.org/2026.gem-main.60/ 2026-07 653 667 Complex-IF and Beyond: Expert Rubrics for RLVR Sushant Mehta author Liudas Panavas author Eleanor Fleming author Paul Mains author Edwin Chen author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 mehta-etal-2026-complex https://aclanthology.org/2026.gem-main.61/ 2026-07 668 677 C2-Faith: Benchmarking LLM Judges for Causal and Coverage Faithfulness in Chain-of-Thought Reasoning Avni Mittal author Rauno Arike author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 mittal-arike-2026-c2 https://aclanthology.org/2026.gem-main.62/ 2026-07 678 691 Evaluating Multilingual Sentiment Classifiers Using an LLM-Annotated Wikipedia Benchmark Milena Stróżyna author Włodzimierz Lewoniewski author Izabela Czumałowska author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 strozyna-etal-2026-evaluating https://aclanthology.org/2026.gem-main.63/ 2026-07 692 703 Process Standardisation for Human Evaluation of NLP System Outputs Craig Thomson author Javier González Corbelle author Anya Belz author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 thomson-etal-2026-process https://aclanthology.org/2026.gem-main.64/ 2026-07 704 717 Language Modeling for the Future of Finance: A Survey into Metrics, Tasks, and Data Opportunities Nikita Tatarinov author Siddhant Sukhani author Agam Shah author Sudheer Chava author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 tatarinov-etal-2026-language https://aclanthology.org/2026.gem-main.65/ 2026-07 718 744 WildIFEval: Instruction Following in the Wild Gili Lior author Asaf Yehudai author Ariel Gera author Liat Ein-Dor author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 lior-etal-2026-wildifeval https://aclanthology.org/2026.gem-main.66/ 2026-07 745 778 EconWebArena: Benchmarking Autonomous Agents on Economic Tasks in Realistic Web Environments Zefang Liu author Yinzhu Quan author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 liu-quan-2026-econwebarena https://aclanthology.org/2026.gem-main.67/ 2026-07 779 796 ISO-Bench: Benchmarking Multimodal Causal Reasoning in Visual–Language Models through Procedural Plans Ananya Sadana author Yash Kumar Lal author Jiawei Zhou author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 sadana-etal-2026-iso https://aclanthology.org/2026.gem-main.68/ 2026-07 797 807 Text Analytics Evaluation Framework: A Case Study on LLMs and Social Media Yuefeng Shi author Nedjma Ousidhoum author Jose Camacho-Collados author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 shi-etal-2026-text https://aclanthology.org/2026.gem-main.69/ 2026-07 808 824 Teaching Values to Machines: Simulating Human-Like Behavior in LLMs Asaf Yehudai author Naama Rozen author Ariel Gera author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 yehudai-etal-2026-teaching https://aclanthology.org/2026.gem-main.70/ 2026-07 825 847 MetaGraph: A Large-Scale Meta-Analysis of GenAI in Financial NLP (2022–2025) Paolo Pedinotti author Peter Baumann author Nathan Jessurun author Leslie Barrett author Enrico Santus author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 pedinotti-etal-2026-metagraph https://aclanthology.org/2026.gem-main.71/ 2026-07 848 861 When Users Are Happy but Agents Are Wrong: Multi-Dimensional Evaluation of Tool-Augmented Dialogue Tanya Shourya author Yingfan Wang author Zhaoyi Joey Hou author Shamik Roy author Vinayshekhar Bannihatti Kumar author Rashmi Gangadharaiah author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 shourya-etal-2026-users https://aclanthology.org/2026.gem-main.72/ 2026-07 862 892 Tool-Aware Planning for Contact-Center Analytics: Evaluating LLMs through Lineage-Guided Query Decomposition Varun Nathan author Shreyas Guha author Ayush Kumar author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 nathan-etal-2026-tool https://aclanthology.org/2026.gem-main.73/ 2026-07 893 943 TSAQA: Time Series Analysis Question And Answering Benchmark Baoyu Jing author Sanhorn Chen author Lecheng Zheng author Boyu Liu author Zihao Li author Jiaru Zou author Tianxin Wei author Zhining Liu author Zhichen Zeng author Ruizhong Qiu author Xiao Lin author Yuchen Yan author Dongqi Fu author Jingchao Ni author Jingrui He author Hanghang Tong author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 jing-etal-2026-tsaqa https://aclanthology.org/2026.gem-main.74/ 2026-07 944 979 Who Endorsed It? Measuring Authority Bias Across Expertise Levels in Language Models Priyanka Mary Mammen author Emil Joswin author Shankar Venkitachalam author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 mammen-etal-2026-endorsed https://aclanthology.org/2026.gem-main.75/ 2026-07 980 989 Reference Games as a Testbed for the Alignment of Model Uncertainty and Clarification Requests Manar Ali author Judith Sieker author Sina Zarrieß author Hendrik Buschmeier author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 ali-etal-2026-reference https://aclanthology.org/2026.gem-main.76/ 2026-07 990 998 Mapping Out the NLP Evaluation Landscape with a Standard Taxonomy of Quality Criteria Anya Belz author Simon Mille author Craig Thomson author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 belz-etal-2026-mapping https://aclanthology.org/2026.gem-main.77/ 2026-07 999 1014 Position: Toward a Metric Typology for Language Model Evaluation Jasper Kyle Catapang author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 catapang-2026-position https://aclanthology.org/2026.gem-main.78/ 2026-07 1015 1020 Position: What Are We Measuring? Rethinking Evaluation in Natural Language Generation Wajdi Zaghouani author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 zaghouani-2026-position https://aclanthology.org/2026.gem-main.79/ 2026-07 1021 1028 Position: Evaluation Scores Are Perishable Knowledge Claims Sankalp Gilda author Shlok Gilda author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 gilda-gilda-2026-position https://aclanthology.org/2026.gem-main.80/ 2026-07 1029 1035 Position: A Semiotic-Hermeneutic Approach to Evaluating Meaning in LLM Summaries via the Inductive Conceptual Rating Metric Natalie Perez author Sreyoshi Bhaduri author Aman Chadha author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 perez-etal-2026-position https://aclanthology.org/2026.gem-main.81/ 2026-07 1036 1047 Position: Scores Without Context? Rethinking the Role of Evaluation in the Era of LLMs Jiawei Zhou author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 zhou-2026-position https://aclanthology.org/2026.gem-main.82/ 2026-07 1048 1054 The Shared Task on Reproducibility of Evaluations in NLP (ReproNLP) 2026: Overview and Results Anya Belz author Craig Thomson author Javier González Corbelle author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 belz-etal-2026-shared https://aclanthology.org/2026.gem-main.83/ 2026-07 1055 1070 Do Nugget-Based Evaluation Patterns Generalize to List-QA? MohammadJavad Ardestani author Ehsan Kamalloo author Davood Rafiei author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 ardestani-etal-2026-nugget https://aclanthology.org/2026.gem-main.84/ 2026-07 1071 1081 ReproNLP 2026: A Third Replication of the Human Evaluation of a QAG System for Children’s Storybooks Marcel Mroczek author Chiara Albarello author Paul-Emmanuel Floch author Maciej Gawinecki author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 mroczek-etal-2026-repronlp https://aclanthology.org/2026.gem-main.85/ 2026-07 1082 1093 ReproHum #0124-03: Reproducing Human Scores on Neural REG Models Maurice Langner author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 langner-2026-reprohum https://aclanthology.org/2026.gem-main.86/ 2026-07 1094 1103 ReproHum #0866-04: Variability in Human Judgments of Sociopolitical Acceptability Across Studies Rui Fan author Guanyi Chen author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 fan-chen-2026-reprohum https://aclanthology.org/2026.gem-main.87/ 2026-07 1104 1110 ReproHum #0031–01: Reproducing a Human Readability Evaluation for Question–Answer Generation Systems Manuela Hürlimann author Mark Cieliebak author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 hurlimann-cieliebak-2026-reprohum https://aclanthology.org/2026.gem-main.88/ 2026-07 1111 1116 ReproHum #0033-05: Human Evaluation Report on “Generating Scientific Definitions with Controllable Complexity” Ines Arous author Jackie Chi Kit Cheung author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 arous-cheung-2026-reprohum https://aclanthology.org/2026.gem-main.89/ 2026-07 1117 1126 ReproHum #0669-08: Reproducing a Recipe for Arbitrary Text Style Transfer with LLMs Saad Mahamood author 2026-07 text Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM) Simon Mille editor Sebastian Gehrmann editor Patrícia Schmidtová editor Ondřej Dušek editor Marzieh Fadaee editor Kyle Lo editor Enrico Santus editor Gabriel Stanovsky editor Association for Computational Linguistics San Diego, California, USA conference publication 979-8-89176-423-1 mahamood-2026-reprohum https://aclanthology.org/2026.gem-main.90/ 2026-07 1127 1132