Replication issues in syntax-based aspect extraction for opinion mining

Edison Marrese-Taylor, Yutaka Matsuo


Abstract
Reproducing experiments is an important instrument to validate previous work and build upon existing approaches. It has been tackled numerous times in different areas of science. In this paper, we introduce an empirical replicability study of three well-known algorithms for syntactic centric aspect-based opinion mining. We show that reproducing results continues to be a difficult endeavor, mainly due to the lack of details regarding preprocessing and parameter setting, as well as due to the absence of available implementations that clarify these details. We consider these are important threats to validity of the research on the field, specifically when compared to other problems in NLP where public datasets and code availability are critical validity components. We conclude by encouraging code-based research, which we think has a key role in helping researchers to understand the meaning of the state-of-the-art better and to generate continuous advances.
Anthology ID:
E17-4003
Volume:
Proceedings of the Student Research Workshop at the 15th Conference of the European Chapter of the Association for Computational Linguistics
Month:
April
Year:
2017
Address:
Valencia, Spain
Editors:
Florian Kunneman, Uxoa Iñurrieta, John J. Camilleri, Mariona Coll Ardanuy
Venue:
EACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
23–32
Language:
URL:
https://aclanthology.org/E17-4003
DOI:
Bibkey:
Cite (ACL):
Edison Marrese-Taylor and Yutaka Matsuo. 2017. Replication issues in syntax-based aspect extraction for opinion mining. In Proceedings of the Student Research Workshop at the 15th Conference of the European Chapter of the Association for Computational Linguistics, pages 23–32, Valencia, Spain. Association for Computational Linguistics.
Cite (Informal):
Replication issues in syntax-based aspect extraction for opinion mining (Marrese-Taylor & Matsuo, EACL 2017)
Copy Citation:
PDF:
https://aclanthology.org/E17-4003.pdf
Code
 epochx/opminreplicability