Upaya at ArabicNLU Shared-Task: Arabic Lexical Disambiguation using Large Language Models

Pawan Rajpoot, Ashvini Jindal, Ankur Parikh


Abstract
Disambiguating a word’s intended meaning(sense) in a given context is important in Nat-ural Language Understanding (NLU). WSDaims to determine the correct sense of ambigu-ous words in context. At the same time, LMD(a WSD variation) focuses on disambiguatinglocation mention. Both tasks are vital in Nat-ural Language Processing (NLP) and informa-tion retrieval, as they help correctly interpretand extract information from text. Arabic ver-sion is further challenging because of its mor-phological richness, encompassing a complexinterplay of roots, stems, and affixes. This pa-per describes our solutions to both tasks, em-ploying Llama3 and Cohere-based models un-der Zero-Shot Learning and Re-Ranking, re-spectively. Both the shared tasks were partof the second Arabic Natural Language Pro-cessing Conference co-located with ACL 2024.Overall, we achieved 1st rank in the WSD task(accuracy 78%) and 2nd rank in the LMD task(MRR@1 0.59)
Anthology ID:
2024.arabicnlp-1.32
Volume:
Proceedings of The Second Arabic Natural Language Processing Conference
Month:
August
Year:
2024
Address:
Bangkok, Thailand
Editors:
Nizar Habash, Houda Bouamor, Ramy Eskander, Nadi Tomeh, Ibrahim Abu Farha, Ahmed Abdelali, Samia Touileb, Injy Hamed, Yaser Onaizan, Bashar Alhafni, Wissam Antoun, Salam Khalifa, Hatem Haddad, Imed Zitouni, Badr AlKhamissi, Rawan Almatham, Khalil Mrini
Venues:
ArabicNLP | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
377–382
Language:
URL:
https://aclanthology.org/2024.arabicnlp-1.32
DOI:
10.18653/v1/2024.arabicnlp-1.32
Bibkey:
Cite (ACL):
Pawan Rajpoot, Ashvini Jindal, and Ankur Parikh. 2024. Upaya at ArabicNLU Shared-Task: Arabic Lexical Disambiguation using Large Language Models. In Proceedings of The Second Arabic Natural Language Processing Conference, pages 377–382, Bangkok, Thailand. Association for Computational Linguistics.
Cite (Informal):
Upaya at ArabicNLU Shared-Task: Arabic Lexical Disambiguation using Large Language Models (Rajpoot et al., ArabicNLP-WS 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.arabicnlp-1.32.pdf