Language technology tools and resources for the analysis of multimodal communication

László Hunyadi, Tamás Váradi, István Szekrényes


Abstract
In this paper we describe how the complexity of human communication can be analysed with the help of language technology. We present the HuComTech corpus, a multimodal corpus containing 50 hours of videotaped interviews containing a rich annotation of about 2 million items annotated on 33 levels. The corpus serves as a general resource for a wide range of re-search addressing natural conversation between humans in their full complexity. It can benefit particularly digital humanities researchers working in the field of pragmatics, conversational analysis and discourse analysis. We will present a number of tools and automated methods that can help such enquiries. In particular, we will highlight the tool Theme, which is designed to uncover hidden temporal patterns (called T-patterns) in human interaction, and will show how it can applied to the study of multimodal communication.
Anthology ID:
W16-4016
Volume:
Proceedings of the Workshop on Language Technology Resources and Tools for Digital Humanities (LT4DH)
Month:
December
Year:
2016
Address:
Osaka, Japan
Venues:
LT4DH | WS
SIG:
Publisher:
The COLING 2016 Organizing Committee
Note:
Pages:
117–124
Language:
URL:
https://aclanthology.org/W16-4016
DOI:
Bibkey:
Cite (ACL):
László Hunyadi, Tamás Váradi, and István Szekrényes. 2016. Language technology tools and resources for the analysis of multimodal communication. In Proceedings of the Workshop on Language Technology Resources and Tools for Digital Humanities (LT4DH), pages 117–124, Osaka, Japan. The COLING 2016 Organizing Committee.
Cite (Informal):
Language technology tools and resources for the analysis of multimodal communication (Hunyadi et al., 2016)
Copy Citation:
PDF:
https://aclanthology.org/W16-4016.pdf