Adding Determinism to a Dialogue Agent for a Robotic Environment

Oihana Garcia Anakabe, Riccardo Cocola, Cristina Aceta


Abstract
Large Language Models (LLMs) have strong capabilities in natural dialogue, but their inherent indeterminacy presents challenges in robotic environments where safety and reliability are critical. In this study, we propose a dialogue agent that has been developed to guide and support human operators during robot demonstrations, following the Learning from Demonstration (LfD) paradigm, where the robot learns tasks from the operator’s actions. The agent presented in this work extends the standard prompt-based LLM setup by integrating state graphs that explicitly encode dialogue states and transitions. This structure ensures that user interactions follow the intended path, while still allowing users to communicate in a flexible and natural manner. The state graph agent is benchmarked against a monolithic prompt baseline in challenging dialogue scenarios involving ambiguity, incomplete actions, or operator errors. Despite the LLM prompt achieving good standalone performance, the state-controlled agent shows greater contextual understanding, reasoning capability, and advisory performance, leading to more intelligent and reliable interactions.
Anthology ID:
2026.iwsds-1.26
Volume:
Proceedings of the 16th International Workshop on Spoken Dialogue System Technology
Month:
February
Year:
2026
Address:
Trento, Italy
Editors:
Giuseppe Riccardi, Seyed Mahed Mousavi, Maria Ines Torres, Koichiro Yoshino, Zoraida Callejas, Shammur Absar Chowdhury, Yun-Nung Chen, Frederic Bechet, Joakim Gustafson, Géraldine Damnati, Alex Papangelis, Luis Fernando D’Haro, John Mendonça, Raffaella Bernardi, Dilek Hakkani-Tur, Giuseppe "Pino" Di Fabbrizio, Tatsuya Kawahara, Firoj Alam, Gokhan Tur, Michael Johnston
Venue:
IWSDS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
253–261
Language:
URL:
https://aclanthology.org/2026.iwsds-1.26/
DOI:
Bibkey:
Cite (ACL):
Oihana Garcia Anakabe, Riccardo Cocola, and Cristina Aceta. 2026. Adding Determinism to a Dialogue Agent for a Robotic Environment. In Proceedings of the 16th International Workshop on Spoken Dialogue System Technology, pages 253–261, Trento, Italy. Association for Computational Linguistics.
Cite (Informal):
Adding Determinism to a Dialogue Agent for a Robotic Environment (Garcia Anakabe et al., IWSDS 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.iwsds-1.26.pdf