Beta-LR: Interpretable Logical Reasoning based on Beta Distribution

Yizhuo Ma, Ke Qin, Shuang Liang


Abstract
The logical information contained in text isof significant importance for logical reasoning.Previous approaches have relied on embeddingtext into a low-dimensional vector to capturelogical information and perform reasoning inEuclidean space. These methods involve constructing special graph architectures that matchlogical relations or designing data augmentation frameworks by extending texts based onsymbolic logic. However, it presents two obvious problems. 1) The logical informationreflected in the text exhibits uncertainty that isdifficult to represent using a vector. 2) Integrating logical information requires modeling logical operations (such as ∪, ∩, and ¬), while onlysimple arithmetic operations can be performedin Euclidean space. To address both the problems, we propose Beta-LR, a probabilistic embedding method to capture logical information.Specifically, we embed texts into beta distribution on each dimension to eliminate logical uncertainty. We also define neural operators thatenable interpretability and perform logical operations based on the characteristics of the betadistribution. We conduct experiments on twodatasets, ReClor and LogiQA, and our Beta-LRachieves competitive results. The experimentsdemonstrate that our method effectively captures the logical information in text for reasoning purposes. The source code is available athttps://github.com/myz12138/Beta-LR.
Anthology ID:
2024.findings-naacl.126
Volume:
Findings of the Association for Computational Linguistics: NAACL 2024
Month:
June
Year:
2024
Address:
Mexico City, Mexico
Editors:
Kevin Duh, Helena Gomez, Steven Bethard
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1945–1955
Language:
URL:
https://aclanthology.org/2024.findings-naacl.126
DOI:
Bibkey:
Cite (ACL):
Yizhuo Ma, Ke Qin, and Shuang Liang. 2024. Beta-LR: Interpretable Logical Reasoning based on Beta Distribution. In Findings of the Association for Computational Linguistics: NAACL 2024, pages 1945–1955, Mexico City, Mexico. Association for Computational Linguistics.
Cite (Informal):
Beta-LR: Interpretable Logical Reasoning based on Beta Distribution (Ma et al., Findings 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.findings-naacl.126.pdf
Copyright:
 2024.findings-naacl.126.copyright.pdf