SubmissionNumber#=%=#16
FinalPaperTitle#=%=#Do Not Score the Edited Answer: A Negative Result on Loose Evaluation for Verifiable Instruction Following
ShortPaperTitle#=%=#
NumberOfPages#=%=#5
CopyrightSigned#=%=#José Luis Delgado
JobTitle#==#
Organization#==#
Abstract#==#Verifiable instruction-following benchmarks often include strict and loose scoring modes: strict scoring checks the original response, and loose scoring applies the checker to transformed versions of the response, for example after removing markdown or dropping boundary lines, to recover false negatives caused by harmless wrappers and formatting artifacts. We study a negative result for this repair strategy using a constructive suite of 144 canaries in which every valid wrapper is paired with an invalid deletion trap that has the same transformed-response checker outcomes under IFEval-style transformations. Loose scoring accepts all valid wrappers and all invalid traps; support over transformation functions accepts both classes, and a threshold that deduplicates passing edited strings rejects both classes. On the balanced suite, any scorer that observes only the transformed-view pass signature has a best possible accuracy of 0.50, and the canaries are solved only by a boundary-aware certificate that inspects the original deleted span. Deletion- or normalization-based loose evaluation therefore needs evidence-preservation checks when edited spans may affect instruction satisfaction.
Author{1}{Firstname}#=%=#José Luis
Author{1}{Lastname}#=%=#Delgado
Author{1}{Username}#=%=#jdelgado
Author{1}{Orcid}#=%=#
Author{1}{Email}#=%=#jdelgado13@uoc.edu
Author{1}{Affiliation}#=%=#Universitat Oberta de Catalunya

==========
èéáğö