DadmaTools: Natural Language Processing Toolkit for Persian Language

Romina Etezadi, Mohammad Karrabi, Najmeh Zare, Mohamad Bagher Sajadi, Mohammad Taher Pilehvar


Abstract
We introduce DadmaTools, an open-source Python Natural Language Processing toolkit for the Persian language. The toolkit is a neural pipeline based on spaCy for several text processing tasks, including normalization, tokenization, lemmatization, part-of-speech, dependency parsing, constituency parsing, chunking, and ezafe detecting. DadmaTools relies on fine-tuning of ParsBERT using the PerDT dataset for most of the tasks. Dataset module and embedding module are included in DadmaTools that support different Persian datasets, embeddings, and commonly used functions for them. Our evaluations show that DadmaTools can attain state-of-the-art performance on multiple NLP tasks. The source code is freely available at https://github.com/Dadmatech/DadmaTools.
Anthology ID:
2022.naacl-demo.13
Volume:
Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies: System Demonstrations
Month:
July
Year:
2022
Address:
Hybrid: Seattle, Washington + Online
Editors:
Hannaneh Hajishirzi, Qiang Ning, Avi Sil
Venue:
NAACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
124–130
Language:
URL:
https://aclanthology.org/2022.naacl-demo.13
DOI:
10.18653/v1/2022.naacl-demo.13
Bibkey:
Cite (ACL):
Romina Etezadi, Mohammad Karrabi, Najmeh Zare, Mohamad Bagher Sajadi, and Mohammad Taher Pilehvar. 2022. DadmaTools: Natural Language Processing Toolkit for Persian Language. In Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies: System Demonstrations, pages 124–130, Hybrid: Seattle, Washington + Online. Association for Computational Linguistics.
Cite (Informal):
DadmaTools: Natural Language Processing Toolkit for Persian Language (Etezadi et al., NAACL 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.naacl-demo.13.pdf
Video:
 https://aclanthology.org/2022.naacl-demo.13.mp4
Code
 dadmatech/dadmatools