TurnStyle: Suggesting Style Prompts for Instruction-Guided Text-to-Speech Using Bimodal Dialogue Contexts

Jack McLaughlin, Cecilia O Alm


Abstract
Instruction-guided text-to-speech (TTS) systems are among the most intuitive for controllable speech synthesis, but writing descriptive instructions in the form of style prompts is too cumbersome for users to maintain natural conversation rhythm. We introduce TurnStyle, a prompt generation system, that produces style prompts for instruction-guided TTS, leveraging a bimodal dialogue history (speech and text transcripts) and a user script query. To address the unintuitive interface problem, TurnStyle creates a style prompt by conditioning the Llama-3.2-3B-Instruct model on a prefix vector generated from an embedded bimodal representation of a dialogue. Computational experiments with performance measured across standard metrics like BERTscore and ROUGE-L show that TurnStyle’s architecture improved on a comparative baseline model for the understudied task of style prompt generation. The introduced model also consumed over 15 times less energy than the baseline and required less memory, suggesting that the TurnStyle framework may feasibly run on edge devices.
Anthology ID:
2026.salma-1.1
Volume:
The Proceedings of Speech and Audio Language Models Workshop (2nd Edition)
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Santosh T.Y.S.S., Sreyan Ghosh, Ramani Duraiswami, Shinji Watanabe, Siddhant Arora, Sonal Kumar, Yossi Adi, Dinesh Manocha, Leibny Paola Garcia Perera
Venues:
SALMA | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1–10
Language:
URL:
https://aclanthology.org/2026.salma-1.1/
DOI:
Bibkey:
Cite (ACL):
Jack McLaughlin and Cecilia O Alm. 2026. TurnStyle: Suggesting Style Prompts for Instruction-Guided Text-to-Speech Using Bimodal Dialogue Contexts. In The Proceedings of Speech and Audio Language Models Workshop (2nd Edition), pages 1–10, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
TurnStyle: Suggesting Style Prompts for Instruction-Guided Text-to-Speech Using Bimodal Dialogue Contexts (McLaughlin & Alm, SALMA 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.salma-1.1.pdf