GMNLP at SemEval-2023 Task 12: Sentiment Analysis with Phylogeny-Based Adapters

Md Mahfuz Ibn Alam, Ruoyu Xie, Fahim Faisal, Antonios Anastasopoulos


Abstract
This report describes GMU’s sentiment analysis system for the SemEval-2023 shared task AfriSenti-SemEval. We participated in all three sub-tasks: Monolingual, Multilingual, and Zero-Shot. Our approach uses models initialized with AfroXLMR-large, a pre-trained multilingual language model trained on African languages and fine-tuned correspondingly. We also introduce augmented training data along with original training data. Alongside finetuning, we perform phylogeny-based adapter-tuning to create several models and ensemble the best models for the final submission. Our system achieves the best F1-score on track 5: Amharic, with 6.2 points higher F1-score than the second-best performing system on this track. Overall, our system ranks 5th among the 10 systems participating in all 15 tracks.
Anthology ID:
2023.semeval-1.163
Volume:
Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023)
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Atul Kr. Ojha, A. Seza Doğruöz, Giovanni Da San Martino, Harish Tayyar Madabushi, Ritesh Kumar, Elisa Sartori
Venue:
SemEval
SIG:
SIGLEX
Publisher:
Association for Computational Linguistics
Note:
Pages:
1172–1182
Language:
URL:
https://aclanthology.org/2023.semeval-1.163
DOI:
10.18653/v1/2023.semeval-1.163
Bibkey:
Cite (ACL):
Md Mahfuz Ibn Alam, Ruoyu Xie, Fahim Faisal, and Antonios Anastasopoulos. 2023. GMNLP at SemEval-2023 Task 12: Sentiment Analysis with Phylogeny-Based Adapters. In Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023), pages 1172–1182, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
GMNLP at SemEval-2023 Task 12: Sentiment Analysis with Phylogeny-Based Adapters (Alam et al., SemEval 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.semeval-1.163.pdf
Video:
 https://aclanthology.org/2023.semeval-1.163.mp4