Event-Based Knowledge MLM for Arabic Event Detection

Asma Z Yamani, Amjad K Alsulami, Rabeah A Al-Zaidy


Abstract
With the fast pace of reporting around the globe from various sources, event extraction has increasingly become an important task in NLP. The use of pre-trained language models (PTMs) has become popular to provide contextual representation for downstream tasks. This work aims to pre-train language models that enhance event extraction accuracy. To this end, we propose an Event-Based Knowledge (EBK) masking approach to mask the most significant terms in the event detection task. These significant terms are based on an external knowledge source that is curated for the purpose of event detection for the Arabic language. The proposed approach improves the classification accuracy of all the 9 event types. The experimental results demonstrate the effectiveness of the proposed masking approach and encourage further exploration.
Anthology ID:
2022.wanlp-1.25
Volume:
Proceedings of the Seventh Arabic Natural Language Processing Workshop (WANLP)
Month:
December
Year:
2022
Address:
Abu Dhabi, United Arab Emirates (Hybrid)
Editors:
Houda Bouamor, Hend Al-Khalifa, Kareem Darwish, Owen Rambow, Fethi Bougares, Ahmed Abdelali, Nadi Tomeh, Salam Khalifa, Wajdi Zaghouani
Venue:
WANLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
273–286
Language:
URL:
https://aclanthology.org/2022.wanlp-1.25
DOI:
10.18653/v1/2022.wanlp-1.25
Bibkey:
Cite (ACL):
Asma Z Yamani, Amjad K Alsulami, and Rabeah A Al-Zaidy. 2022. Event-Based Knowledge MLM for Arabic Event Detection. In Proceedings of the Seventh Arabic Natural Language Processing Workshop (WANLP), pages 273–286, Abu Dhabi, United Arab Emirates (Hybrid). Association for Computational Linguistics.
Cite (Informal):
Event-Based Knowledge MLM for Arabic Event Detection (Yamani et al., WANLP 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.wanlp-1.25.pdf