Disentangling Extraction and Reasoning in Multi-hop Spatial Reasoning

Roshanak Mirzaee, Parisa Kordjamshidi


Abstract
Spatial reasoning over text is challenging as the models not only need to extract the direct spatial information from the text but also reason over those and infer implicit spatial relations. Recent studies highlight the struggles even large language models encounter when it comes to performing spatial reasoning over text. In this paper, we explore the potential benefits of disentangling the processes of information extraction and reasoning in models to address this challenge. To explore this, we design various models that disentangle extraction and reasoning(either symbolic or neural) and compare them with state-of-the-art(SOTA) baselines with no explicit design for these parts. Our experimental results consistently demonstrate the efficacy of disentangling, showcasing its ability to enhance models’ generalizability within realistic data domains.
Anthology ID:
2023.findings-emnlp.221
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2023
Month:
December
Year:
2023
Address:
Singapore
Editors:
Houda Bouamor, Juan Pino, Kalika Bali
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
3379–3397
Language:
URL:
https://aclanthology.org/2023.findings-emnlp.221
DOI:
10.18653/v1/2023.findings-emnlp.221
Bibkey:
Cite (ACL):
Roshanak Mirzaee and Parisa Kordjamshidi. 2023. Disentangling Extraction and Reasoning in Multi-hop Spatial Reasoning. In Findings of the Association for Computational Linguistics: EMNLP 2023, pages 3379–3397, Singapore. Association for Computational Linguistics.
Cite (Informal):
Disentangling Extraction and Reasoning in Multi-hop Spatial Reasoning (Mirzaee & Kordjamshidi, Findings 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.findings-emnlp.221.pdf