Text Completion using Context-Integrated Dependency Parsing

Amr Rekaby Salama, Özge Alaçam, Wolfgang Menzel


Abstract
Incomplete linguistic input, i.e. due to a noisy environment, is one of the challenges that a successful communication system has to deal with. In this paper, we study text completion with a data set composed of sentences with gaps where a successful completion cannot be achieved through a uni-modal (language-based) approach. We present a solution based on a context-integrating dependency parser incorporating an additional non-linguistic modality. An incompleteness in one channel is compensated by information from another one and the parser learns the association between the two modalities from a multiple level knowledge representation. We examined several model variations by adjusting the degree of influence of different modalities in the decision making on possible filler words and their exact reference to a non-linguistic context element. Our model is able to fill the gap with 95.4% word and 95.2% exact reference accuracy hence the successful prediction can be achieved not only on the word level (such as mug) but also with respect to the correct identification of its context reference (such as mug 2 among several mug instances).
Anthology ID:
W18-3005
Volume:
Proceedings of the Third Workshop on Representation Learning for NLP
Month:
July
Year:
2018
Address:
Melbourne, Australia
Editors:
Isabelle Augenstein, Kris Cao, He He, Felix Hill, Spandana Gella, Jamie Kiros, Hongyuan Mei, Dipendra Misra
Venue:
RepL4NLP
SIG:
SIGREP
Publisher:
Association for Computational Linguistics
Note:
Pages:
41–49
Language:
URL:
https://aclanthology.org/W18-3005
DOI:
10.18653/v1/W18-3005
Bibkey:
Cite (ACL):
Amr Rekaby Salama, Özge Alaçam, and Wolfgang Menzel. 2018. Text Completion using Context-Integrated Dependency Parsing. In Proceedings of the Third Workshop on Representation Learning for NLP, pages 41–49, Melbourne, Australia. Association for Computational Linguistics.
Cite (Informal):
Text Completion using Context-Integrated Dependency Parsing (Salama et al., RepL4NLP 2018)
Copy Citation:
PDF:
https://aclanthology.org/W18-3005.pdf