”So, are you a different person today?” Analyzing Bias in Questions during Parole Hearings

Wassiliki Siskou, Ingrid Espinoza


Abstract
During Parole Suitability Hearings commissioners need to evaluate whether an inmate’s risk of reoffending has decreased sufficiently to justify their release from prison before completing their full sentence. The conversation between the commissioners and the inmate is the key element of such hearings and is largely driven by question-and-answer patterns which can be influenced by the commissioner’s questioning behavior. To our knowledge, no previous study has investigated the relationship between the types of questions asked during parole hearings and potentially biased outcomes. We address this gap by analysing commissioner’s questioning behavior during Californian parole hearings. We test ChatGPT-4o’s capability of annotating questions automatically and achieve a high F1-score of 0.91 without prior training. By analysing all questions posed directly by commissioners to inmates, we tested for potential biases in question types across multiple demographic variables. The results show minimal bias in questioning behavior toward inmates asking for parole.
Anthology ID:
2024.sicon-1.8
Volume:
Proceedings of the Second Workshop on Social Influence in Conversations (SICon 2024)
Month:
November
Year:
2024
Address:
Miami, Florida, USA
Editors:
James Hale, Kushal Chawla, Muskan Garg
Venue:
SICon
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
116–128
Language:
URL:
https://aclanthology.org/2024.sicon-1.8
DOI:
Bibkey:
Cite (ACL):
Wassiliki Siskou and Ingrid Espinoza. 2024. ”So, are you a different person today?” Analyzing Bias in Questions during Parole Hearings. In Proceedings of the Second Workshop on Social Influence in Conversations (SICon 2024), pages 116–128, Miami, Florida, USA. Association for Computational Linguistics.
Cite (Informal):
”So, are you a different person today?” Analyzing Bias in Questions during Parole Hearings (Siskou & Espinoza, SICon 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.sicon-1.8.pdf