Enhancing Telugu Part-of-Speech Tagging with Deep Sequential Models and Multilingual Embeddings

Mangamuru Sai Rishith Reddy, Karnati Sai Prashanth, Sajja Bala Karthikeya, Phogat Divith, B. Premjith


Abstract
Part-of-speech (POS) tagging is a fundamental task in natural language processing (NLP) that involves assigning grammatical categories to words in a sentence. In this study, we investigate the application of deep sequential models for POS tagging of Telugu, a low-resource Dravidian language with rich morphology. We use the Universal dependencies dataset for this research and explore various deep learning architectures, including Recurrent Neural Networks (RNNs), Long Short-Term Memory (LSTM) networks, Gated Recurrent Units (GRUs), and their stacked variants for POS tagging. Additionally, we utilize multilingual BERT embeddings and indicBERT embeddings to capture contextual information from the input sequences. Our experiments demonstrate that stacked LSTM with multilingual BERT embeddings achieves the highest performance, outperforming other approaches and attaining an F1 score of 0.8812. These findings suggest that deep sequential models, particularly stacked LSTMs with multilingual BERT embeddings, are effective tools for POS tagging in Telugu.
Anthology ID:
2023.icon-1.77
Volume:
Proceedings of the 20th International Conference on Natural Language Processing (ICON)
Month:
December
Year:
2023
Address:
Goa University, Goa, India
Editors:
D. Pawar Jyoti, Lalitha Devi Sobha
Venue:
ICON
SIG:
SIGLEX
Publisher:
NLP Association of India (NLPAI)
Note:
Pages:
760–765
Language:
URL:
https://aclanthology.org/2023.icon-1.77
DOI:
Bibkey:
Cite (ACL):
Mangamuru Sai Rishith Reddy, Karnati Sai Prashanth, Sajja Bala Karthikeya, Phogat Divith, and B. Premjith. 2023. Enhancing Telugu Part-of-Speech Tagging with Deep Sequential Models and Multilingual Embeddings. In Proceedings of the 20th International Conference on Natural Language Processing (ICON), pages 760–765, Goa University, Goa, India. NLP Association of India (NLPAI).
Cite (Informal):
Enhancing Telugu Part-of-Speech Tagging with Deep Sequential Models and Multilingual Embeddings (Sai Rishith Reddy et al., ICON 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.icon-1.77.pdf