MSI-SQL: Unleashing Data Potential of Large Language Models for Text-to-SQL via Multi-Task Self-Iterative Generation

Li Gao, Zixuan Wang, Boci Peng, Mingjun Nie, Huan Luo, Chun Gan


Abstract
Text-to-SQL parsing increasingly relies on high-quality Chain-of-Thought (CoT) data to train specialized models. However, eliciting accurate reasoning paths for complex queries remains a formidable challenge, causing existing methods to suffer from severe data underutilization and fragile free-form generation. To systematically resolve these issues, we propose MSI-SQL, a Multi-task Self-Iterative framework that enhances both data quantity and quality. To expand data scale, we introduce a verification-based self-iterative loop that progressively conquers difficult queries. To ensure reasoning stability, we design a masked SQL completion auxiliary task that serves as a structural anchor, explicitly constraining the CoT generation space. Coupled with a novel mask-augmented soft self-consistency mechanism during inference, evaluations on the BIRD and Spider benchmarks demonstrate that MSI-SQL establishes a new state-of-the-art for open-source Text-to-SQL parsers.
Anthology ID:
2026.findings-emnlp.2390
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
51372–51382
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.2390/
DOI:
Bibkey:
Cite (ACL):
Li Gao, Zixuan Wang, Boci Peng, Mingjun Nie, Huan Luo, and Chun Gan. 2026. MSI-SQL: Unleashing Data Potential of Large Language Models for Text-to-SQL via Multi-Task Self-Iterative Generation. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 51372–51382, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
MSI-SQL: Unleashing Data Potential of Large Language Models for Text-to-SQL via Multi-Task Self-Iterative Generation (Gao et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.2390.pdf