System 1 + System 2 = Better World: Neural-Symbolic Chain of Logic Reasoning

Wenyue Hua, Yongfeng Zhang


Abstract
Logical reasoning is a challenge for many current NLP neural network models since it requires more than the ability of learning informative representations from data. Inspired by the Dual Process Theory in cognitive science — which proposes that human cognition process involves two stages: an intuitive, unconscious and fast process relying on perception calledSystem 1, and a logical, conscious and slow process performing complex reasoning called System 2 — we leverage neural logic reasoning (System 2) on top of the representation learning models (System 1), which conducts explicit neural-based differentiable logical reasoning on top of the representations learned by the base neural models. Based on experiments on the commonsense knowledge graph completion task, we show that the two-system architecture always improves from its System 1 model alone. Experiments also show that both the rule-driven logical regularizer and the data-driven value regularizer are important and the performance improvement is marginal without the two regularizers, which indicates that learning from both logical prior and training data is important for reasoning tasks.
Anthology ID:
2022.findings-emnlp.42
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2022
Month:
December
Year:
2022
Address:
Abu Dhabi, United Arab Emirates
Editors:
Yoav Goldberg, Zornitsa Kozareva, Yue Zhang
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
601–612
Language:
URL:
https://aclanthology.org/2022.findings-emnlp.42
DOI:
10.18653/v1/2022.findings-emnlp.42
Bibkey:
Cite (ACL):
Wenyue Hua and Yongfeng Zhang. 2022. System 1 + System 2 = Better World: Neural-Symbolic Chain of Logic Reasoning. In Findings of the Association for Computational Linguistics: EMNLP 2022, pages 601–612, Abu Dhabi, United Arab Emirates. Association for Computational Linguistics.
Cite (Informal):
System 1 + System 2 = Better World: Neural-Symbolic Chain of Logic Reasoning (Hua & Zhang, Findings 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.findings-emnlp.42.pdf
Video:
 https://aclanthology.org/2022.findings-emnlp.42.mp4