Aspect based Sentiment Analysis in Hindi: Resource Creation and Evaluation

Md Shad Akhtar, Asif Ekbal, Pushpak Bhattacharyya


Abstract
Due to the phenomenal growth of online product reviews, sentiment analysis (SA) has gained huge attention, for example, by online service providers. A number of benchmark datasets for a wide range of domains have been made available for sentiment analysis, especially in resource-rich languages. In this paper we assess the challenges of SA in Hindi by providing a benchmark setup, where we create an annotated dataset of high quality, build machine learning models for sentiment analysis in order to show the effective usage of the dataset, and finally make the resource available to the community for further advancement of research. The dataset comprises of Hindi product reviews crawled from various online sources. Each sentence of the review is annotated with aspect term and its associated sentiment. As classification algorithms we use Conditional Random Filed (CRF) and Support Vector Machine (SVM) for aspect term extraction and sentiment analysis, respectively. Evaluation results show the average F-measure of 41.07% for aspect term extraction and accuracy of 54.05% for sentiment classification.
Anthology ID:
L16-1429
Volume:
Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16)
Month:
May
Year:
2016
Address:
Portorož, Slovenia
Editors:
Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Sara Goggi, Marko Grobelnik, Bente Maegaard, Joseph Mariani, Helene Mazo, Asuncion Moreno, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
2703–2709
Language:
URL:
https://aclanthology.org/L16-1429
DOI:
Bibkey:
Cite (ACL):
Md Shad Akhtar, Asif Ekbal, and Pushpak Bhattacharyya. 2016. Aspect based Sentiment Analysis in Hindi: Resource Creation and Evaluation. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16), pages 2703–2709, Portorož, Slovenia. European Language Resources Association (ELRA).
Cite (Informal):
Aspect based Sentiment Analysis in Hindi: Resource Creation and Evaluation (Akhtar et al., LREC 2016)
Copy Citation:
PDF:
https://aclanthology.org/L16-1429.pdf