Correcting Semantic Parses with Natural Language through Dynamic Schema Encoding

Parker Glenn, Parag Pravin Dakle, Preethi Raghavan


Abstract
In addressing the task of converting natural language to SQL queries, there are several semantic and syntactic challenges. It becomes increasingly important to understand and remedy the points of failure as the performance of semantic parsing systems improve. We explore semantic parse correction with natural language feedback, proposing a new solution built on the success of autoregressive decoders in text-to-SQL tasks. By separating the semantic and syntactic difficulties of the task, we show that the accuracy of text-to-SQL parsers can be boosted by up to 26% with only one turn of correction with natural language. Additionally, we show that a T5-base model is capable of correcting the errors of a T5-large model in a zero-shot, cross-parser setting.
Anthology ID:
2023.nlp4convai-1.3
Volume:
Proceedings of the 5th Workshop on NLP for Conversational AI (NLP4ConvAI 2023)
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Yun-Nung Chen, Abhinav Rastogi
Venue:
NLP4ConvAI
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
29–38
Language:
URL:
https://aclanthology.org/2023.nlp4convai-1.3
DOI:
10.18653/v1/2023.nlp4convai-1.3
Bibkey:
Cite (ACL):
Parker Glenn, Parag Pravin Dakle, and Preethi Raghavan. 2023. Correcting Semantic Parses with Natural Language through Dynamic Schema Encoding. In Proceedings of the 5th Workshop on NLP for Conversational AI (NLP4ConvAI 2023), pages 29–38, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
Correcting Semantic Parses with Natural Language through Dynamic Schema Encoding (Glenn et al., NLP4ConvAI 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.nlp4convai-1.3.pdf
Video:
 https://aclanthology.org/2023.nlp4convai-1.3.mp4