KIQA: Knowledge-Infused Question Answering Model for Financial Table-Text Data

Rungsiman Nararatwong, Natthawut Kertkeidkachorn, Ryutaro Ichise


Abstract
While entity retrieval models continue to advance their capabilities, our understanding of their wide-ranging applications is limited, especially in domain-specific settings. We highlighted this issue by using recent general-domain entity-linking models, LUKE and GENRE, to inject external knowledge into a question-answering (QA) model for a financial QA task with a hybrid tabular-textual dataset. We found that both models improved the baseline model by 1.57% overall and 8.86% on textual data. Nonetheless, the challenge remains as they still struggle to handle tabular inputs. We subsequently conducted a comprehensive attention-weight analysis, revealing how LUKE utilizes external knowledge supplied by GENRE. The analysis also elaborates how the injection of symbolic knowledge can be helpful and what needs further improvement, paving the way for future research on this challenging QA task and advancing our understanding of how a language model incorporates external knowledge.
Anthology ID:
2022.deelio-1.6
Volume:
Proceedings of Deep Learning Inside Out (DeeLIO 2022): The 3rd Workshop on Knowledge Extraction and Integration for Deep Learning Architectures
Month:
May
Year:
2022
Address:
Dublin, Ireland and Online
Editors:
Eneko Agirre, Marianna Apidianaki, Ivan Vulić
Venue:
DeeLIO
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
53–61
Language:
URL:
https://aclanthology.org/2022.deelio-1.6
DOI:
10.18653/v1/2022.deelio-1.6
Bibkey:
Cite (ACL):
Rungsiman Nararatwong, Natthawut Kertkeidkachorn, and Ryutaro Ichise. 2022. KIQA: Knowledge-Infused Question Answering Model for Financial Table-Text Data. In Proceedings of Deep Learning Inside Out (DeeLIO 2022): The 3rd Workshop on Knowledge Extraction and Integration for Deep Learning Architectures, pages 53–61, Dublin, Ireland and Online. Association for Computational Linguistics.
Cite (Informal):
KIQA: Knowledge-Infused Question Answering Model for Financial Table-Text Data (Nararatwong et al., DeeLIO 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.deelio-1.6.pdf
Video:
 https://aclanthology.org/2022.deelio-1.6.mp4
Data
TAT-QA