Flip, Don’t Shuffle: Watermarking LLMs at the Speed of Inference

Simone Ceppi, Ignacio Sanchez


Abstract
We introduce Stateless Bernoulli Watermarking (SBW), a new statistical watermark for Large Language Models that determines green list membership through independent per-token Bernoulli trials. Unlike KGW’s vocabulary permutation or SynthID’s multi-layer tournament, SBW requires only a single comparison per token against a counter-based random number generator, reducing membership complexity to O(1) and enabling single-kernel execution with zero intermediate allocations. We prove that this formulation preserves the same detection guarantees as fixed-size green lists: the z-score test remains 𝒩(0,1) under the null. The stateless architecture enables capabilities unavailable to existing methods: full-vocabulary self-salt watermarking (over 6000× faster than KGW’s self-salt and 2× faster than SynthID despite biasing the entire vocabulary with candidate-dependent seeding) and architectural compatibility with distributed inference. In end-to-end generation benchmarks, SBW adds less than 1% overhead at all batch sizes. We additionally identify hash function design as a previously unexplored axis for watermark quality, showing that a GPU-native Jenkins hash improves null calibration by 1.8× while producing more diverse text. Experiments across two seeding schemes and eight (𝛾, 𝛿) configurations confirm statistical equivalence with ROC-AUC differences below 0.01.
Anthology ID:
2026.emnlp-main.2124
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
48312–48328
Language:
URL:
https://aclanthology.org/2026.emnlp-main.2124/
DOI:
Bibkey:
Cite (ACL):
Simone Ceppi and Ignacio Sanchez. 2026. Flip, Don’t Shuffle: Watermarking LLMs at the Speed of Inference. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 48312–48328, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Flip, Don’t Shuffle: Watermarking LLMs at the Speed of Inference (Ceppi & Sanchez, EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.2124.pdf