A Deep Transfer Learning Method for Cross-Lingual Natural Language Inference

Dibyanayan Bandyopadhyay, Arkadipta De, Baban Gain, Tanik Saikh, Asif Ekbal


Abstract
Natural Language Inference (NLI), also known as Recognizing Textual Entailment (RTE), has been one of the central tasks in Artificial Intelligence (AI) and Natural Language Processing (NLP). RTE between the two pieces of texts is a crucial problem, and it adds further challenges when involving two different languages, i.e., in the cross-lingual scenario. This paper proposes an effective transfer learning approach for cross-lingual NLI. We perform experiments on English-Hindi language pairs in the cross-lingual setting to find out that our novel loss formulation could enhance the performance of the baseline model by up to 2%. To assess the effectiveness of our method further, we perform additional experiments on every possible language pair using four European languages, namely French, German, Bulgarian, and Turkish, on top of XNLI dataset. Evaluation results yield up to 10% performance improvement over the respective baseline models, in some cases surpassing the state-of-the-art (SOTA). It is also to be noted that our proposed model has 110M parameters which is much lesser than the SOTA model having 220M parameters. Finally, we argue that our transfer learning-based loss objective is model agnostic and thus can be used with other deep learning-based architectures for cross-lingual NLI.
Anthology ID:
2022.lrec-1.330
Volume:
Proceedings of the Thirteenth Language Resources and Evaluation Conference
Month:
June
Year:
2022
Address:
Marseille, France
Editors:
Nicoletta Calzolari, Frédéric Béchet, Philippe Blache, Khalid Choukri, Christopher Cieri, Thierry Declerck, Sara Goggi, Hitoshi Isahara, Bente Maegaard, Joseph Mariani, Hélène Mazo, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association
Note:
Pages:
3084–3092
Language:
URL:
https://aclanthology.org/2022.lrec-1.330
DOI:
Bibkey:
Cite (ACL):
Dibyanayan Bandyopadhyay, Arkadipta De, Baban Gain, Tanik Saikh, and Asif Ekbal. 2022. A Deep Transfer Learning Method for Cross-Lingual Natural Language Inference. In Proceedings of the Thirteenth Language Resources and Evaluation Conference, pages 3084–3092, Marseille, France. European Language Resources Association.
Cite (Informal):
A Deep Transfer Learning Method for Cross-Lingual Natural Language Inference (Bandyopadhyay et al., LREC 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.lrec-1.330.pdf
Data
SNLIXNLI