DRANZIERA: An Evaluation Protocol For Multi-Domain Opinion Mining

Mauro Dragoni, Andrea Tettamanzi, Célia da Costa Pereira


Abstract
Opinion Mining is a topic which attracted a lot of interest in the last years. By observing the literature, it is often hard to replicate system evaluation due to the unavailability of the data used for the evaluation or to the lack of details about the protocol used in the campaign. In this paper, we propose an evaluation protocol, called DRANZIERA, composed of a multi-domain dataset and guidelines allowing both to evaluate opinion mining systems in different contexts (Closed, Semi-Open, and Open) and to compare them to each other and to a number of baselines.
Anthology ID:
L16-1041
Volume:
Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16)
Month:
May
Year:
2016
Address:
Portorož, Slovenia
Editors:
Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Sara Goggi, Marko Grobelnik, Bente Maegaard, Joseph Mariani, Helene Mazo, Asuncion Moreno, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
267–272
Language:
URL:
https://aclanthology.org/L16-1041
DOI:
Bibkey:
Cite (ACL):
Mauro Dragoni, Andrea Tettamanzi, and Célia da Costa Pereira. 2016. DRANZIERA: An Evaluation Protocol For Multi-Domain Opinion Mining. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16), pages 267–272, Portorož, Slovenia. European Language Resources Association (ELRA).
Cite (Informal):
DRANZIERA: An Evaluation Protocol For Multi-Domain Opinion Mining (Dragoni et al., LREC 2016)
Copy Citation:
PDF:
https://aclanthology.org/L16-1041.pdf