Text-To-KG Alignment: Comparing Current Methods on Classification Tasks

Sondre Wold, Lilja Øvrelid, Erik Velldal


Abstract
In contrast to large text corpora, knowledge graphs (KG) provide dense and structured representations of factual information. This makes them attractive for systems that supplement or ground the knowledge found in pre-trained language models with an external knowledge source. This has especially been the case for classification tasks, where recent work has focused on creating pipeline models that retrieve information from KGs like ConceptNet as additional context. Many of these models consist of multiple components, and although they differ in the number and nature of these parts, they all have in common that for some given text query, they attempt to identify and retrieve a relevant subgraph from the KG. Due to the noise and idiosyncrasies often found in KGs, it is not known how current methods compare to a scenario where the aligned subgraph is completely relevant to the query. In this work, we try to bridge this knowledge gap by reviewing current approaches to text-to-KG alignment and evaluating them on two datasets where manually created graphs are available, providing insights into the effectiveness of current methods. We release our code for reproducibility.
Anthology ID:
2023.matching-1.1
Volume:
Proceedings of the First Workshop on Matching From Unstructured and Structured Data (MATCHING 2023)
Month:
July
Year:
2023
Address:
Toronto, ON, Canada
Editors:
Estevam Hruschka, Tom Mitchell, Sajjadur Rahman, Dunja Mladenić, Marko Grobelnik
Venue:
MATCHING
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1–13
Language:
URL:
https://aclanthology.org/2023.matching-1.1
DOI:
10.18653/v1/2023.matching-1.1
Bibkey:
Cite (ACL):
Sondre Wold, Lilja Øvrelid, and Erik Velldal. 2023. Text-To-KG Alignment: Comparing Current Methods on Classification Tasks. In Proceedings of the First Workshop on Matching From Unstructured and Structured Data (MATCHING 2023), pages 1–13, Toronto, ON, Canada. Association for Computational Linguistics.
Cite (Informal):
Text-To-KG Alignment: Comparing Current Methods on Classification Tasks (Wold et al., MATCHING 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.matching-1.1.pdf
Video:
 https://aclanthology.org/2023.matching-1.1.mp4