Modeling Speech Acts in Asynchronous Conversations: A Neural-CRF Approach

Shafiq Joty, Tasnim Mohiuddin


Abstract
Participants in an asynchronous conversation (e.g., forum, e-mail) interact with each other at different times, performing certain communicative acts, called speech acts (e.g., question, request). In this article, we propose a hybrid approach to speech act recognition in asynchronous conversations. Our approach works in two main steps: a long short-term memory recurrent neural network (LSTM-RNN) first encodes each sentence separately into a task-specific distributed representation, and this is then used in a conditional random field (CRF) model to capture the conversational dependencies between sentences. The LSTM-RNN model uses pretrained word embeddings learned from a large conversational corpus and is trained to classify sentences into speech act types. The CRF model can consider arbitrary graph structures to model conversational dependencies in an asynchronous conversation. In addition, to mitigate the problem of limited annotated data in the asynchronous domains, we adapt the LSTM-RNN model to learn from synchronous conversations (e.g., meetings), using domain adversarial training of neural networks. Empirical evaluation shows the effectiveness of our approach over existing ones: (i) LSTM-RNNs provide better task-specific representations, (ii) conversational word embeddings benefit the LSTM-RNNs more than the off-the-shelf ones, (iii) adversarial training gives better domain-invariant representations, and (iv) the global CRF model improves over local models.
Anthology ID:
J18-4012
Volume:
Computational Linguistics, Volume 44, Issue 4 - December 2018
Month:
December
Year:
2018
Address:
Cambridge, MA
Venue:
CL
SIG:
Publisher:
MIT Press
Note:
Pages:
859–894
Language:
URL:
https://aclanthology.org/J18-4012
DOI:
10.1162/coli_a_00339
Bibkey:
Cite (ACL):
Shafiq Joty and Tasnim Mohiuddin. 2018. Modeling Speech Acts in Asynchronous Conversations: A Neural-CRF Approach. Computational Linguistics, 44(4):859–894.
Cite (Informal):
Modeling Speech Acts in Asynchronous Conversations: A Neural-CRF Approach (Joty & Mohiuddin, CL 2018)
Copy Citation:
PDF:
https://aclanthology.org/J18-4012.pdf