Logical Inference for Counting on Semi-structured Tables

Tomoya Kurosawa, Hitomi Yanaka


Abstract
Recently, the Natural Language Inference (NLI) task has been studied for semi-structured tables that do not have a strict format. Although neural approaches have achieved high performance in various types of NLI, including NLI between semi-structured tables and texts, they still have difficulty in performing a numerical type of inference, such as counting. To handle a numerical type of inference, we propose a logical inference system for reasoning between semi-structured tables and texts. We use logical representations as meaning representations for tables and texts and use model checking to handle a numerical type of inference between texts and tables. To evaluate the extent to which our system can perform inference with numerical comparatives, we make an evaluation protocol that focuses on numerical understanding between semi-structured tables and texts in English. We show that our system can more robustly perform inference between tables and texts that requires numerical understanding compared with current neural approaches.
Anthology ID:
2022.acl-srw.8
Volume:
Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics: Student Research Workshop
Month:
May
Year:
2022
Address:
Dublin, Ireland
Editors:
Samuel Louvan, Andrea Madotto, Brielen Madureira
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
84–96
Language:
URL:
https://aclanthology.org/2022.acl-srw.8
DOI:
10.18653/v1/2022.acl-srw.8
Bibkey:
Cite (ACL):
Tomoya Kurosawa and Hitomi Yanaka. 2022. Logical Inference for Counting on Semi-structured Tables. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics: Student Research Workshop, pages 84–96, Dublin, Ireland. Association for Computational Linguistics.
Cite (Informal):
Logical Inference for Counting on Semi-structured Tables (Kurosawa & Yanaka, ACL 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.acl-srw.8.pdf
Code
 ynklab/sst_count
Data
InfoTabS