UM6P at SemEval-2023 Task 12: Out-Of-Distribution Generalization Method for African Languages Sentiment Analysis

Abdelkader El Mahdaouy, Hamza Alami, Salima Lamsiyah, Ismail Berrada


Abstract
This paper presents our submitted system to AfriSenti SemEval-2023 Task 12: Sentiment Analysis for African Languages. The AfriSenti consists of three different tasks, covering monolingual, multilingual, and zero-shot sentiment analysis scenarios for African languages. To improve model generalization, we have explored the following steps: 1) further pre-training of the AfroXLM Pre-trained Language Model (PLM), 2) combining AfroXLM and MARBERT PLMs using a residual layer, and 3) studying the impact of metric learning and two out-of-distribution generalization training objectives. The overall evaluation results show that our system has achieved promising results on several sub-tasks of Task A. For Tasks B and C, our system is ranked among the top six participating systems.
Anthology ID:
2023.semeval-1.138
Volume:
Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023)
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Atul Kr. Ojha, A. Seza Doğruöz, Giovanni Da San Martino, Harish Tayyar Madabushi, Ritesh Kumar, Elisa Sartori
Venue:
SemEval
SIG:
SIGLEX
Publisher:
Association for Computational Linguistics
Note:
Pages:
1004–1010
Language:
URL:
https://aclanthology.org/2023.semeval-1.138
DOI:
10.18653/v1/2023.semeval-1.138
Bibkey:
Cite (ACL):
Abdelkader El Mahdaouy, Hamza Alami, Salima Lamsiyah, and Ismail Berrada. 2023. UM6P at SemEval-2023 Task 12: Out-Of-Distribution Generalization Method for African Languages Sentiment Analysis. In Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023), pages 1004–1010, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
UM6P at SemEval-2023 Task 12: Out-Of-Distribution Generalization Method for African Languages Sentiment Analysis (El Mahdaouy et al., SemEval 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.semeval-1.138.pdf