CLEF: Closed-Loop Error Feedback for Multi-Bit Watermarking in Short LLM-Generated Text

Jing Wang, Kejun Qian, Pengyu Xiong, Qiankun Zhang, Yi Yang, Jing Fan


Abstract
Multi-bit watermarking for large language models (LLMs) enables richer provenance information, but existing schemes remain unreliable for short texts because they rely on local or pre-specified allocation strategies. To address this limitation, we propose a Closed-Loop Error Feedback (CLEF) Multi-Bit Watermarking framework. By treating the LLM as a noisy channel, CLEF tracks the global feature state of generated tokens and dynamically measures its deviation from an ideal multidimensional target trajectory. The resulting dynamic error vector is then used to modulate the logits of candidate tokens via an inner-product scoring mechanism, biasing generation toward tokens that compensate for underrepresented payload dimensions. This closed-loop control enables robust multi-bit embedding with a simple, fully linear decoding process. Experiments on short-text generation show that CLEF improves bit extraction accuracy and complete message recovery rate over the evaluated multi-bit watermarking baselines. Furthermore, CLEF achieves higher bit extraction accuracy under different text perturbations while maintaining acceptable generation quality across downstream tasks such as text summarization and machine translation.
Anthology ID:
2026.aacl-long.190
Volume:
Proceedings of the 15th International Joint Conference on Natural Language Processing and the 5th Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
November
Year:
2026
Address:
Hengqin, China
Editors:
Yue Zhang, Ruifeng Xu, Ayu Purwarianti, Tong Rong, Jun Suzuki
Venues:
AACL | IJCNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
4244–4260
Language:
URL:
https://aclanthology.org/2026.aacl-long.190/
DOI:
Bibkey:
Cite (ACL):
Jing Wang, Kejun Qian, Pengyu Xiong, Qiankun Zhang, Yi Yang, and Jing Fan. 2026. CLEF: Closed-Loop Error Feedback for Multi-Bit Watermarking in Short LLM-Generated Text. In Proceedings of the 15th International Joint Conference on Natural Language Processing and the 5th Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (Volume 1: Long Papers), pages 4244–4260, Hengqin, China. Association for Computational Linguistics.
Cite (Informal):
CLEF: Closed-Loop Error Feedback for Multi-Bit Watermarking in Short LLM-Generated Text (Wang et al., AACL-IJCNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.aacl-long.190.pdf