Counter-GEO-Bench: Evaluating Defenses Against Information-Distorting Generative Engine Optimization

Bing Zheng, Zongyao Zhao, Wenming Yang


Abstract
Generative engine optimization (GEO) enables content producers to increase the visibility of their web pages in generative search engines, but the same techniques can deliver targeted misinformation when adversaries publish ordinary-looking GEO-optimized documents that victim large language models (LLMs) retrieve and synthesize into distorted answers. No existing benchmark evaluates defenses against this threat under controlled conditions. Therefore, we present Counter-GEO-Bench, a defense benchmark that pairs 247 human-verified, quality-gated queries with information-preserving and information-distorting GEO rewrites, and evaluates defenses on attack success rate (ASR), false positive rate, and answer quality across three victim LLMs. Under Counter-GEO-Bench, three off-the-shelf defenses (Granite Guardian, Llama Guard 3, and NeMo Self-Check Fact-Checking) reduce ASR by at most 5.7% relative, while Granite Guardian’s reduction is not statistically significant. Safety-taxonomy guardrails target policy violations, while GEO misinformation passes through them as fluent informational content. To this end, a lightweight benchmark baseline, C-GEO Guard, is proposed, reducing ASR by 47.6% relative with near-zero utility loss, which proves threat tractable.
Anthology ID:
2026.emnlp-main.1472
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
33673–33689
Language:
URL:
https://aclanthology.org/2026.emnlp-main.1472/
DOI:
Bibkey:
Cite (ACL):
Bing Zheng, Zongyao Zhao, and Wenming Yang. 2026. Counter-GEO-Bench: Evaluating Defenses Against Information-Distorting Generative Engine Optimization. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 33673–33689, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Counter-GEO-Bench: Evaluating Defenses Against Information-Distorting Generative Engine Optimization (Zheng et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.1472.pdf