Joint Inference for Mode Identification in Tutorial Dialogues

Deepak Venugopal, Vasile Rus


Abstract
Identifying dialogue acts and dialogue modes during tutorial interactions is an extremely crucial sub-step in understanding patterns of effective tutor-tutee interactions. In this work, we develop a novel joint inference method that labels each utterance in a tutoring dialogue session with a dialogue act and a specific mode from a set of pre-defined dialogue acts and modes, respectively. Specifically, we develop our joint model using Markov Logic Networks (MLNs), a framework that combines first-order logic with probabilities, and is thus capable of representing complex, uncertain knowledge. We define first-order formulas in our MLN that encode the inter-dependencies between dialogue modes and more fine-grained dialogue actions. We then use a joint inference to jointly label the modes as well as the dialogue acts in an utterance. We compare our system against a pipeline system based on SVMs on a real-world dataset with tutoring sessions of over 500 students. Our results show that the joint inference system is far more effective than the pipeline system in mode detection, and improves over the performance of the pipeline system by about 6 points in F1 score. The joint inference system also performs much better than the pipeline system in the context of labeling modes that highlight important pedagogical steps in tutoring.
Anthology ID:
C16-1188
Volume:
Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers
Month:
December
Year:
2016
Address:
Osaka, Japan
Editors:
Yuji Matsumoto, Rashmi Prasad
Venue:
COLING
SIG:
Publisher:
The COLING 2016 Organizing Committee
Note:
Pages:
2000–2011
Language:
URL:
https://aclanthology.org/C16-1188
DOI:
Bibkey:
Cite (ACL):
Deepak Venugopal and Vasile Rus. 2016. Joint Inference for Mode Identification in Tutorial Dialogues. In Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers, pages 2000–2011, Osaka, Japan. The COLING 2016 Organizing Committee.
Cite (Informal):
Joint Inference for Mode Identification in Tutorial Dialogues (Venugopal & Rus, COLING 2016)
Copy Citation:
PDF:
https://aclanthology.org/C16-1188.pdf