GailBot: An automatic transcription system for Conversation Analysis

Muhammad Umair, Julia Beret Mertens, Saul Albert, Jan Peter De Ruiter


Abstract
Researchers studying human interaction, such as conversation analysts, psychologists, and linguists, all rely on detailed transcriptions of language use. Ideally, these should include so-called paralinguistic features of talk, such as overlaps, prosody, and intonation, as they convey important information. However, creating conversational transcripts that include these features by hand requires substantial amounts of time by trained transcribers. There are currently no Speech to Text (STT) systems that are able to integrate these features in the generated transcript. To reduce the resources needed to create detailed conversation transcripts that include representation of paralinguistic features, we developed a program called GailBot. GailBot combines STT services with plugins to automatically generate first drafts of transcripts that largely follow the transcription standards common in the field of Conversation Analysis. It also enables researchers to add new plugins to transcribe additional features, or to improve the plugins it currently uses. We describe GailBot’s architecture and its use of computational heuristics and machine learning. We also evaluate its output in relation to transcripts produced by both human transcribers and comparable automated transcription systems. We argue that despite its limitations, GailBot represents a substantial improvement over existing dialogue transcription software.
Anthology ID:
2022.dnd-13.5
Volume:
Dialogue Discourse Volume 13
Month:
April
Year:
2022
Address:
Chicago, Illinois, USA
Editors:
Amanda Stent, Barbara Di Eugenio, Massimo Poesio, Kallirroi Georgila, Manfred Stede
Venue:
DND
SIG:
SIGDIAL
Publisher:
University of Illinois Chicago
Note:
Pages:
63–95
Language:
URL:
https://aclanthology.org/2022.dnd-13.5/
DOI:
10.5210/dad.2022.103
Bibkey:
Cite (ACL):
Muhammad Umair, Julia Beret Mertens, Saul Albert, and Jan Peter De Ruiter. 2022. GailBot: An automatic transcription system for Conversation Analysis. Dialogue & Discourse, 13:63–95.
Cite (Informal):
GailBot: An automatic transcription system for Conversation Analysis (Umair et al., DND 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.dnd-13.5.pdf