Cross-lingual Data Augmentation for Document-grounded Dialog Systems in Low Resource Languages

Qi Gou, Zehua Xia, Wenzhe Du


Abstract
This paper proposes a framework to address the issue of data scarcity in Document-Grounded Dialogue Systems(DGDS). Our model leverages high-resource languages to enhance the capability of dialogue generation in low-resource languages. Specifically, We present a novel pipeline CLEM (Cross-Lingual Enhanced Model) including adversarial training retrieval (Retriever and Re-ranker), and Fid (fusion-in-decoder) generator. To further leverage high-resource language, we also propose an innovative architecture to conduct alignment across different languages with translated training. Extensive experiment results demonstrate the effectiveness of our model and we achieved 4th place in the DialDoc 2023 Competition. Therefore, CLEM can serve as a solution to resource scarcity in DGDS and provide useful guidance for multi-lingual alignment tasks.
Anthology ID:
2023.dialdoc-1.1
Volume:
Proceedings of the Third DialDoc Workshop on Document-grounded Dialogue and Conversational Question Answering
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Smaranda Muresan, Vivian Chen, Kennington Casey, Vandyke David, Dethlefs Nina, Inoue Koji, Ekstedt Erik, Ultes Stefan
Venue:
dialdoc
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1–7
Language:
URL:
https://aclanthology.org/2023.dialdoc-1.1
DOI:
10.18653/v1/2023.dialdoc-1.1
Bibkey:
Cite (ACL):
Qi Gou, Zehua Xia, and Wenzhe Du. 2023. Cross-lingual Data Augmentation for Document-grounded Dialog Systems in Low Resource Languages. In Proceedings of the Third DialDoc Workshop on Document-grounded Dialogue and Conversational Question Answering, pages 1–7, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
Cross-lingual Data Augmentation for Document-grounded Dialog Systems in Low Resource Languages (Gou et al., dialdoc 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.dialdoc-1.1.pdf