Probing Ambiguity: Adversarial Intent Resolution for Robust Text-to-SQL

Youbing Yin, Xujun Peng, Muhammad Sharif Uddin, Erin Babinsky, Daben Liu, Anoop Kumar


Abstract
Text-to-SQL systems typically assume a one-to-one mapping between natural-language queries and correct SQL translations. In practice, however, many queries are inherently ambiguous, admitting multiple valid interpretations that yield distinct outputs. We introduce Adversarial Intent Resolution (AIR), a multi-agent framework that actively probes and resolves such ambiguity without any task-specific training. AIR first constructs competing interpretations, verifies through SQL execution that they produce genuinely different results, and generates targeted clarification questions grounded in the observed data differences. Evaluating on leading benchmarks for ambiguous questions, AIR demonstrates strong performance, efficiency, and robust cross-benchmark transferability. On the AMBROSIA benchmark under schema-only context—a realistic production setting where exposing the full database is infeasible—AIR outperforms IntentRL, the state-of-the-art reinforcement learning model, across all metrics (e.g., F1 0.679 vs. 0.618). Crucially, AIR exhibits only ∼7% performance degradation without the full database, compared to ∼20% for IntentRL. On the AmbiQT benchmark, where ambiguity arises from schema design rather than linguistic structure, AIR achieves higher F1 under both context settings without any benchmark-specific adaptation.
Anthology ID:
2026.emnlp-main.2446
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
55493–55504
Language:
URL:
https://aclanthology.org/2026.emnlp-main.2446/
DOI:
Bibkey:
Cite (ACL):
Youbing Yin, Xujun Peng, Muhammad Sharif Uddin, Erin Babinsky, Daben Liu, and Anoop Kumar. 2026. Probing Ambiguity: Adversarial Intent Resolution for Robust Text-to-SQL. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 55493–55504, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Probing Ambiguity: Adversarial Intent Resolution for Robust Text-to-SQL (Yin et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.2446.pdf