Multilingual Generation and Answering of Questions from Texts and Knowledge Graphs

Kelvin Han, Claire Gardent


Abstract
The ability to bridge Question Generation (QG) and Question Answering (QA) across structured and unstructured modalities has the potential for aiding different NLP applications. One key application is in QA-based methods that have recently been shown to be useful for automatically evaluating Natural Language (NL) texts generated from Knowledge Graphs (KG). While methods have been proposed for QG-QA across these modalities, these efforts have been in English only; in this work, we bring multilinguality (Brazilian Portuguese and Russian) to multimodal (KG and NL) QG-QA. Using synthetic data generation and machine translation to produce QG-QA data that is aligned between graph and text, we are able to train multimodal, multi-task models that can perform multimodal QG and QA in Portuguese and Russian. We show that our approach outperforms a baseline which is derived from previous work on English and adapted to handle these two languages.
Anthology ID:
2023.findings-emnlp.918
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2023
Month:
December
Year:
2023
Address:
Singapore
Editors:
Houda Bouamor, Juan Pino, Kalika Bali
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
13740–13756
Language:
URL:
https://aclanthology.org/2023.findings-emnlp.918
DOI:
10.18653/v1/2023.findings-emnlp.918
Bibkey:
Cite (ACL):
Kelvin Han and Claire Gardent. 2023. Multilingual Generation and Answering of Questions from Texts and Knowledge Graphs. In Findings of the Association for Computational Linguistics: EMNLP 2023, pages 13740–13756, Singapore. Association for Computational Linguistics.
Cite (Informal):
Multilingual Generation and Answering of Questions from Texts and Knowledge Graphs (Han & Gardent, Findings 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.findings-emnlp.918.pdf