AsNER - Annotated Dataset and Baseline for Assamese Named Entity recognition

Dhrubajyoti Pathak, Sukumar Nandi, Priyankoo Sarmah


Abstract
We present the AsNER, a named entity annotation dataset for low resource Assamese language with a baseline Assamese NER model. The dataset contains about 99k tokens comprised of text from the speech of the Prime Minister of India and Assamese play. It also contains person names, location names and addresses. The proposed NER dataset is likely to be a significant resource for deep neural based Assamese language processing. We benchmark the dataset by training NER models and evaluating using state-of-the-art architectures for supervised named entity recognition (NER) such as Fasttext, BERT, XLM-R, FLAIR, MuRIL etc. We implement several baseline approaches with state-of-the-art sequence tagging Bi-LSTM-CRF architecture. The highest F1-score among all baselines achieves an accuracy of 80.69% when using MuRIL as a word embedding method. The annotated dataset and the top performing model are made publicly available.
Anthology ID:
2022.lrec-1.706
Volume:
Proceedings of the Thirteenth Language Resources and Evaluation Conference
Month:
June
Year:
2022
Address:
Marseille, France
Editors:
Nicoletta Calzolari, Frédéric Béchet, Philippe Blache, Khalid Choukri, Christopher Cieri, Thierry Declerck, Sara Goggi, Hitoshi Isahara, Bente Maegaard, Joseph Mariani, Hélène Mazo, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association
Note:
Pages:
6571–6577
Language:
URL:
https://aclanthology.org/2022.lrec-1.706
DOI:
Bibkey:
Cite (ACL):
Dhrubajyoti Pathak, Sukumar Nandi, and Priyankoo Sarmah. 2022. AsNER - Annotated Dataset and Baseline for Assamese Named Entity recognition. In Proceedings of the Thirteenth Language Resources and Evaluation Conference, pages 6571–6577, Marseille, France. European Language Resources Association.
Cite (Informal):
AsNER - Annotated Dataset and Baseline for Assamese Named Entity recognition (Pathak et al., LREC 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.lrec-1.706.pdf
Data
WikiANN