MISSION at KSAA-CAD 2024: AraT5 with Arabic Reverse Dictionary

Thamer Alharbi


Abstract
This research paper presents our approach for the KSAA-CAD 2024 competition, focusing on Arabic Reverse Dictionary (RD) task (Alshammari et al., 2024). Leveraging the functionalities of the Arabic Reverse Dictionary, our system allows users to input glosses and retrieve corresponding words. We provide all associated notebooks and developed models on GitHub and Hugging face, respectively. Our task entails working with a dataset comprising dictionary data and word embedding vectors, utilizing three different architectures of contextualized word embeddings: AraELECTRA, AraBERTv2, and camelBERT-MSA. We fine-tune the AraT5v2-base-1024 model for predicting each embedding, considering various hyperparameters for training and validation. Evaluation metrics include ranking accuracy, mean squared error (MSE), and cosine similarity. The results demonstrate the effectiveness of our approach on both development and test datasets, showcasing promising performance across different embedding types.
Anthology ID:
2024.arabicnlp-1.76
Volume:
Proceedings of The Second Arabic Natural Language Processing Conference
Month:
August
Year:
2024
Address:
Bangkok, Thailand
Editors:
Nizar Habash, Houda Bouamor, Ramy Eskander, Nadi Tomeh, Ibrahim Abu Farha, Ahmed Abdelali, Samia Touileb, Injy Hamed, Yaser Onaizan, Bashar Alhafni, Wissam Antoun, Salam Khalifa, Hatem Haddad, Imed Zitouni, Badr AlKhamissi, Rawan Almatham, Khalil Mrini
Venues:
ArabicNLP | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
692–696
Language:
URL:
https://aclanthology.org/2024.arabicnlp-1.76
DOI:
Bibkey:
Cite (ACL):
Thamer Alharbi. 2024. MISSION at KSAA-CAD 2024: AraT5 with Arabic Reverse Dictionary. In Proceedings of The Second Arabic Natural Language Processing Conference, pages 692–696, Bangkok, Thailand. Association for Computational Linguistics.
Cite (Informal):
MISSION at KSAA-CAD 2024: AraT5 with Arabic Reverse Dictionary (Alharbi, ArabicNLP-WS 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.arabicnlp-1.76.pdf