Bridging Perception, Memory, and Inference through Semantic Relations

Johanna Björklund, Adam Dahlgren Lindström, Frank Drewes


Abstract
There is a growing consensus that surface form alone does not enable models to learn meaning and gain language understanding. This warrants an interest in hybrid systems that combine the strengths of neural and symbolic methods. We favour triadic systems consisting of neural networks, knowledge bases, and inference engines. The network provides perception, that is, the interface between the system and its environment. The knowledge base provides explicit memory and thus immediate access to established facts. Finally, inference capabilities are provided by the inference engine which reflects on the perception, supported by memory, to reason and discover new facts. In this work, we probe six popular language models for semantic relations and outline a future line of research to study how the constituent subsystems can be jointly realised and integrated.
Anthology ID:
2021.emnlp-main.719
Volume:
Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing
Month:
November
Year:
2021
Address:
Online and Punta Cana, Dominican Republic
Editors:
Marie-Francine Moens, Xuanjing Huang, Lucia Specia, Scott Wen-tau Yih
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
9136–9142
Language:
URL:
https://aclanthology.org/2021.emnlp-main.719
DOI:
10.18653/v1/2021.emnlp-main.719
Bibkey:
Cite (ACL):
Johanna Björklund, Adam Dahlgren Lindström, and Frank Drewes. 2021. Bridging Perception, Memory, and Inference through Semantic Relations. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pages 9136–9142, Online and Punta Cana, Dominican Republic. Association for Computational Linguistics.
Cite (Informal):
Bridging Perception, Memory, and Inference through Semantic Relations (Björklund et al., EMNLP 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.emnlp-main.719.pdf
Video:
 https://aclanthology.org/2021.emnlp-main.719.mp4