HSPMark: Desynchronization-Resilient Multi-Bit LLM Watermarking via Semantic Anchoring

Jing Wang, Pengyu Xiong, Kejun Qian, Yi Yang, Jing Fan


Abstract
Reliable multi-bit watermarking is essential for tracing the provenance of large language model (LLM) outputs. However, existing high-capacity schemes typically synchronize pseudo-random functions through discrete token n-gram matching, which makes them vulnerable to desynchronization under semantics-preserving paraphrasing attacks. To address this issue, we propose HSPMark, a hierarchical semantic projection marking mechanism for context-aware multi-bit watermarking, which shifts watermark synchronization from brittle token histories to continuous semantic anchors. HSPMark extracts stable contextual features using a pre-trained sentence-level encoder and a lightweight Robust Semantic MLP, then projects these features into context-conditioned pseudo-orthogonal bias matrices for multi-bit payload injection. To balance payload capacity and generation quality, HSPMark introduces an entropy-adaptive embedding mechanism that modulates logit bias according to predictive uncertainty. Extensive evaluations demonstrate that HSPMark improves robustness against paraphrase-induced desynchronization and local perturbations while maintaining a competitive trade-off among bit accuracy, payload capacity, and text quality compared with existing high-capacity baselines.
Anthology ID:
2026.findings-emnlp.1099
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
23245–23259
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.1099/
DOI:
Bibkey:
Cite (ACL):
Jing Wang, Pengyu Xiong, Kejun Qian, Yi Yang, and Jing Fan. 2026. HSPMark: Desynchronization-Resilient Multi-Bit LLM Watermarking via Semantic Anchoring. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 23245–23259, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
HSPMark: Desynchronization-Resilient Multi-Bit LLM Watermarking via Semantic Anchoring (Wang et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.1099.pdf