A Joint Model for Semantic Sequences: Frames, Entities, Sentiments

Haoruo Peng, Snigdha Chaturvedi, Dan Roth


Abstract
Understanding stories – sequences of events – is a crucial yet challenging natural language understanding task. These events typically carry multiple aspects of semantics including actions, entities and emotions. Not only does each individual aspect contribute to the meaning of the story, so does the interaction among these aspects. Building on this intuition, we propose to jointly model important aspects of semantic knowledge – frames, entities and sentiments – via a semantic language model. We achieve this by first representing these aspects’ semantic units at an appropriate level of abstraction and then using the resulting vector representations for each semantic aspect to learn a joint representation via a neural language model. We show that the joint semantic language model is of high quality and can generate better semantic sequences than models that operate on the word level. We further demonstrate that our joint model can be applied to story cloze test and shallow discourse parsing tasks with improved performance and that each semantic aspect contributes to the model.
Anthology ID:
K17-1019
Volume:
Proceedings of the 21st Conference on Computational Natural Language Learning (CoNLL 2017)
Month:
August
Year:
2017
Address:
Vancouver, Canada
Editors:
Roger Levy, Lucia Specia
Venue:
CoNLL
SIG:
SIGNLL
Publisher:
Association for Computational Linguistics
Note:
Pages:
173–183
Language:
URL:
https://aclanthology.org/K17-1019
DOI:
10.18653/v1/K17-1019
Bibkey:
Cite (ACL):
Haoruo Peng, Snigdha Chaturvedi, and Dan Roth. 2017. A Joint Model for Semantic Sequences: Frames, Entities, Sentiments. In Proceedings of the 21st Conference on Computational Natural Language Learning (CoNLL 2017), pages 173–183, Vancouver, Canada. Association for Computational Linguistics.
Cite (Informal):
A Joint Model for Semantic Sequences: Frames, Entities, Sentiments (Peng et al., CoNLL 2017)
Copy Citation:
PDF:
https://aclanthology.org/K17-1019.pdf
Data
FrameNetROCStories