Exploring the Limits of Prompting LLMs with Speaker-Specific Rhetorical Fingerprints

Wassiliki Siskou, Annette Hautli-Janisz


Abstract
The capabilities of Large Language Models (LLMs) to mimic written content are being tested on a wide range of tasks and settings, from persuasive essays to programming code. However, the question to what extent they are capable of mimicking human conversational monologue is less well-researched. In this study, we explore the limits of popular LLMs in impersonating content in a high-stakes legal setting, namely for the generation of the decision statement in parole suitability hearings: We distill a linguistically well-motivated rhetorical fingerprint from individual presiding commissioners, based on patterns observed in verbatim transcripts and then enhance the model prompts with those characteristics. When comparing this enhanced prompt with an underspecified prompt we show that LLMs can approximate certain rhetorical features when prompted accordingly, but are not able to fully replicate the linguistic profile of the original speakers as their own fingerprint dominates.
Anthology ID:
2025.lm4dh-1.14
Volume:
Proceedings of the First on Natural Language Processing and Language Models for Digital Humanities
Month:
September
Year:
2025
Address:
Varna, Bulgaria
Editors:
Isuri Nanomi Arachchige, Francesca Frontini, Ruslan Mitkov, Paul Rayson
Venues:
LM4DH | WS
SIG:
Publisher:
INCOMA Ltd., Shoumen, Bulgaria
Note:
Pages:
143–154
Language:
URL:
https://aclanthology.org/2025.lm4dh-1.14/
DOI:
Bibkey:
Cite (ACL):
Wassiliki Siskou and Annette Hautli-Janisz. 2025. Exploring the Limits of Prompting LLMs with Speaker-Specific Rhetorical Fingerprints. In Proceedings of the First on Natural Language Processing and Language Models for Digital Humanities, pages 143–154, Varna, Bulgaria. INCOMA Ltd., Shoumen, Bulgaria.
Cite (Informal):
Exploring the Limits of Prompting LLMs with Speaker-Specific Rhetorical Fingerprints (Siskou & Hautli-Janisz, LM4DH 2025)
Copy Citation:
PDF:
https://aclanthology.org/2025.lm4dh-1.14.pdf