Can Authorship Attribution Models Distinguish Speakers in Speech Transcripts?

Cristina Aggazzotti, Nicholas Andrews, Elizabeth Allyn Smith


Abstract
Authorship verification is the task of determining if two distinct writing samples share the same author and is typically concerned with the attribution of written text. In this paper, we explore the attribution of transcribed speech, which poses novel challenges. The main challenge is that many stylistic features, such as punctuation and capitalization, are not informative in this setting. On the other hand, transcribed speech exhibits other patterns, such as filler words and backchannels (e.g., um, uh-huh), which may be characteristic of different speakers. We propose a new benchmark for speaker attribution focused on human-transcribed conversational speech transcripts. To limit spurious associations of speakers with topic, we employ both conversation prompts and speakers participating in the same conversation to construct verification trials of varying difficulties. We establish the state of the art on this new benchmark by comparing a suite of neural and non-neural baselines, finding that although written text attribution models achieve surprisingly good performance in certain settings, they perform markedly worse as conversational topic is increasingly controlled. We present analyses of the impact of transcription style on performance as well as the ability of fine-tuning on speech transcripts to improve performance.1
Anthology ID:
2024.tacl-1.49
Volume:
Transactions of the Association for Computational Linguistics, Volume 12
Month:
Year:
2024
Address:
Cambridge, MA
Venue:
TACL
SIG:
Publisher:
MIT Press
Note:
Pages:
875–891
Language:
URL:
https://aclanthology.org/2024.tacl-1.49
DOI:
10.1162/tacl_a_00678
Bibkey:
Cite (ACL):
Cristina Aggazzotti, Nicholas Andrews, and Elizabeth Allyn Smith. 2024. Can Authorship Attribution Models Distinguish Speakers in Speech Transcripts?. Transactions of the Association for Computational Linguistics, 12:875–891.
Cite (Informal):
Can Authorship Attribution Models Distinguish Speakers in Speech Transcripts? (Aggazzotti et al., TACL 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.tacl-1.49.pdf