Combining Sentiment Lexica with a Multi-View Variational Autoencoder

Alexander Miserlis Hoyle, Lawrence Wolf-Sonkin, Hanna Wallach, Ryan Cotterell, Isabelle Augenstein


Abstract
When assigning quantitative labels to a dataset, different methodologies may rely on different scales. In particular, when assigning polarities to words in a sentiment lexicon, annotators may use binary, categorical, or continuous labels. Naturally, it is of interest to unify these labels from disparate scales to both achieve maximal coverage over words and to create a single, more robust sentiment lexicon while retaining scale coherence. We introduce a generative model of sentiment lexica to combine disparate scales into a common latent representation. We realize this model with a novel multi-view variational autoencoder (VAE), called SentiVAE. We evaluate our approach via a downstream text classification task involving nine English-Language sentiment analysis datasets; our representation outperforms six individual sentiment lexica, as well as a straightforward combination thereof.
Anthology ID:
N19-1065
Volume:
Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers)
Month:
June
Year:
2019
Address:
Minneapolis, Minnesota
Editors:
Jill Burstein, Christy Doran, Thamar Solorio
Venue:
NAACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
635–640
Language:
URL:
https://aclanthology.org/N19-1065
DOI:
10.18653/v1/N19-1065
Bibkey:
Cite (ACL):
Alexander Miserlis Hoyle, Lawrence Wolf-Sonkin, Hanna Wallach, Ryan Cotterell, and Isabelle Augenstein. 2019. Combining Sentiment Lexica with a Multi-View Variational Autoencoder. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), pages 635–640, Minneapolis, Minnesota. Association for Computational Linguistics.
Cite (Informal):
Combining Sentiment Lexica with a Multi-View Variational Autoencoder (Hoyle et al., NAACL 2019)
Copy Citation:
PDF:
https://aclanthology.org/N19-1065.pdf
Code
 ahoho/SentiVAE
Data
IMDb Movie Reviews