Acoustic-Prosodic and Lexical Cues to Deception and Trust: Deciphering How People Detect Lies

Xi (Leslie) Chen, Sarah Ita Levitan, Michelle Levine, Marko Mandic, Julia Hirschberg


Abstract
Humans rarely perform better than chance at lie detection. To better understand human perception of deception, we created a game framework, LieCatcher, to collect ratings of perceived deception using a large corpus of deceptive and truthful interviews. We analyzed the acoustic-prosodic and linguistic characteristics of language trusted and mistrusted by raters and compared these to characteristics of actual truthful and deceptive language to understand how perception aligns with reality. With this data we built classifiers to automatically distinguish trusted from mistrusted speech, achieving an F1 of 66.1%. We next evaluated whether the strategies raters said they used to discriminate between truthful and deceptive responses were in fact useful. Our results show that, although several prosodic and lexical features were consistently perceived as trustworthy, they were not reliable cues. Also, the strategies that judges reported using in deception detection were not helpful for the task. Our work sheds light on the nature of trusted language and provides insight into the challenging problem of human deception detection.
Anthology ID:
2020.tacl-1.14
Volume:
Transactions of the Association for Computational Linguistics, Volume 8
Month:
Year:
2020
Address:
Cambridge, MA
Editors:
Mark Johnson, Brian Roark, Ani Nenkova
Venue:
TACL
SIG:
Publisher:
MIT Press
Note:
Pages:
199–214
Language:
URL:
https://aclanthology.org/2020.tacl-1.14
DOI:
10.1162/tacl_a_00311
Bibkey:
Cite (ACL):
Xi (Leslie) Chen, Sarah Ita Levitan, Michelle Levine, Marko Mandic, and Julia Hirschberg. 2020. Acoustic-Prosodic and Lexical Cues to Deception and Trust: Deciphering How People Detect Lies. Transactions of the Association for Computational Linguistics, 8:199–214.
Cite (Informal):
Acoustic-Prosodic and Lexical Cues to Deception and Trust: Deciphering How People Detect Lies (Chen et al., TACL 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.tacl-1.14.pdf