Using Planning to Improve Semantic Parsing of Instructional Texts

Vanya Cohen, Raymond Mooney


Abstract
We develop a symbolic planning-based decoder to improve the few-shot semantic parsing of instructional texts. The system takes long-form instructional texts as input and produces sequences of actions in a formal language that enable execution of the instructions. This task poses unique challenges since input texts may contain long context dependencies and ambiguous and domain-specific language. Valid semantic parses also require sequences of steps that constitute an executable plan. We build on recent progress in semantic parsing by leveraging large language models to learn parsers from small amounts of training data. During decoding, our method employs planning methods and domain information to rank and correct candidate parses. To validate our method, we evaluate on four domains: two household instruction-following domains and two cooking recipe interpretation domains. We present results for few-shot semantic parsing using leave-one-out cross-validation. We show that utilizing planning domain information improves the quality of generated plans. Through ablations we also explore the effects of our decoder design choices.
Anthology ID:
2023.nlrse-1.5
Volume:
Proceedings of the 1st Workshop on Natural Language Reasoning and Structured Explanations (NLRSE)
Month:
June
Year:
2023
Address:
Toronto, Canada
Editors:
Bhavana Dalvi Mishra, Greg Durrett, Peter Jansen, Danilo Neves Ribeiro, Jason Wei
Venue:
NLRSE
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
47–58
Language:
URL:
https://aclanthology.org/2023.nlrse-1.5
DOI:
10.18653/v1/2023.nlrse-1.5
Bibkey:
Cite (ACL):
Vanya Cohen and Raymond Mooney. 2023. Using Planning to Improve Semantic Parsing of Instructional Texts. In Proceedings of the 1st Workshop on Natural Language Reasoning and Structured Explanations (NLRSE), pages 47–58, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
Using Planning to Improve Semantic Parsing of Instructional Texts (Cohen & Mooney, NLRSE 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.nlrse-1.5.pdf