IESR: Efficient MCTS-Based Modular Reasoning for Text-to-SQL with Large Language Models

Tao Liu, Jiafan Lu, Bohan Yu, Pengcheng Wu, Liu Haixin, Guoyu Xu, Xiangheng Li, Lixiaoli, Jiaming Hou, Zhaoshijun, Xinglin Lyu, Kunli Zhang, Yuxiang Jia, Hongying Zan


Abstract
Text-to-SQL is a key natural language processing task that maps natural language questions to SQL queries, enabling intuitive interaction with web-based databases. Although current methods perform well on benchmarks like BIRD and Spider, they struggle with complex reasoning, domain knowledge, and hypothetical queries, and remain costly in enterprise deployment. To address these issues, we propose a framework named IESR(Information Enhanced Structured Reasoning) for Lightweight Large Language Models: (i) leverages Large Language Models (LLMs) for key information understanding and schema linking, and decoupling mathematical computation and SQL generation, (ii) integrates a multi-path reasoning mechanism based on Monte Carlo Tree Search (MCTS) with majority voting, and (iii) introduces a trajectory consistency verification module with a discriminator model to ensure accuracy and consistency. Experimental results demonstrate that IESR achieves state-of-the-art performance on the complex reasoning benchmark LogicCat (24.28 EX) and the Archer dataset (37.28 EX), using only compact 7B and 8B models without fine-tuning. Furthermore, our analysis reveals that current coder models exhibit notable biases and deficiencies in physical knowledge, mathematical computation, and common-sense reasoning, highlighting important directions for future research. We released code at https://github.com/Ffunkytao/IESR-SLM.
Anthology ID:
2026.emnlp-main.1958
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
44576–44604
Language:
URL:
https://aclanthology.org/2026.emnlp-main.1958/
DOI:
Bibkey:
Cite (ACL):
Tao Liu, Jiafan Lu, Bohan Yu, Pengcheng Wu, Liu Haixin, Guoyu Xu, Xiangheng Li, Lixiaoli, Jiaming Hou, Zhaoshijun, Xinglin Lyu, Kunli Zhang, Yuxiang Jia, and Hongying Zan. 2026. IESR: Efficient MCTS-Based Modular Reasoning for Text-to-SQL with Large Language Models. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 44576–44604, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
IESR: Efficient MCTS-Based Modular Reasoning for Text-to-SQL with Large Language Models (Liu et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.1958.pdf