“Stupid robot, I want to speak to a human!” User Frustration Detection in Task-Oriented Dialog Systems

Mireia Hernandez Caralt, Ivan Sekulic, Filip Carevic, Nghia Khau, Diana Nicoleta Popa, Bruna Guedes, Victor Guimaraes, Zeyu Yang, Andre Manso, Meghana Reddy, Paolo Rosso, Roland Mathis


Abstract
Detecting user frustration in modern-day task-oriented dialog (TOD) systems is imperative for maintaining overall user satisfaction, engagement, and retention. However, most recent research is focused on sentiment and emotion detection in academic settings, thus failing to fully encapsulate implications of real-world user data. To mitigate this gap, in this work, we focus on user frustration in a deployed TOD system, assessing the feasibility of out-of-the-box solutions for user frustration detection. Specifically, we compare the performance of our deployed keyword-based approach, open-source approaches to sentiment analysis, dialog breakdown detection methods, and emerging in-context learning LLM-based detection. Our analysis highlights the limitations of open-source methods for real-world frustration detection, while demonstrating the superior performance of the LLM-based approach, achieving a 16% relative improvement in F1 score on an internal benchmark. Finally, we analyze advantages and limitations of our methods and provide an insight into user frustration detection task for industry practitioners.
Anthology ID:
2025.coling-industry.23
Volume:
Proceedings of the 31st International Conference on Computational Linguistics: Industry Track
Month:
January
Year:
2025
Address:
Abu Dhabi, UAE
Editors:
Owen Rambow, Leo Wanner, Marianna Apidianaki, Hend Al-Khalifa, Barbara Di Eugenio, Steven Schockaert, Kareem Darwish, Apoorv Agarwal
Venue:
COLING
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
276–285
Language:
URL:
https://aclanthology.org/2025.coling-industry.23/
DOI:
Bibkey:
Cite (ACL):
Mireia Hernandez Caralt, Ivan Sekulic, Filip Carevic, Nghia Khau, Diana Nicoleta Popa, Bruna Guedes, Victor Guimaraes, Zeyu Yang, Andre Manso, Meghana Reddy, Paolo Rosso, and Roland Mathis. 2025. “Stupid robot, I want to speak to a human!” User Frustration Detection in Task-Oriented Dialog Systems. In Proceedings of the 31st International Conference on Computational Linguistics: Industry Track, pages 276–285, Abu Dhabi, UAE. Association for Computational Linguistics.
Cite (Informal):
“Stupid robot, I want to speak to a human!” User Frustration Detection in Task-Oriented Dialog Systems (Hernandez Caralt et al., COLING 2025)
Copy Citation:
PDF:
https://aclanthology.org/2025.coling-industry.23.pdf