A Corpus of Comparisons in Product Reviews

Wiltrud Kessler, Jonas Kuhn


Abstract
Sentiment analysis (or opinion mining) deals with the task of determining the polarity of an opinionated document or sentence. Users often express sentiment about one product by comparing it to a different product. In this work, we present a corpus of comparison sentences from English camera reviews. For our purposes we define a comparison to be any statement about the similarity or difference of two entities. For each sentence we have annotated detailed information about the comparisons it contains: The comparative predicate that expresses the comparison, the type of the comparison, the two entities that are being compared, and the aspect they are compared in. The results of our agreement study show that the decision whether a sentence contains a comparison is difficult to make even for trained human annotators. Once that decision is made, we can achieve consistent results for the very detailed annotations. In total, we have annotated 2108 comparisons in 1707 sentences from camera reviews which makes our corpus the largest resource currently available. The corpus and the annotation guidelines are publicly available on our website.
Anthology ID:
L14-1003
Volume:
Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14)
Month:
May
Year:
2014
Address:
Reykjavik, Iceland
Editors:
Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Hrafn Loftsson, Bente Maegaard, Joseph Mariani, Asuncion Moreno, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
2242–2248
Language:
URL:
http://www.lrec-conf.org/proceedings/lrec2014/pdf/1001_Paper.pdf
DOI:
Bibkey:
Cite (ACL):
Wiltrud Kessler and Jonas Kuhn. 2014. A Corpus of Comparisons in Product Reviews. In Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14), pages 2242–2248, Reykjavik, Iceland. European Language Resources Association (ELRA).
Cite (Informal):
A Corpus of Comparisons in Product Reviews (Kessler & Kuhn, LREC 2014)
Copy Citation:
PDF:
http://www.lrec-conf.org/proceedings/lrec2014/pdf/1001_Paper.pdf