Supporting human operators during customer service interactions with agentic-RAG

Juan Barrionuevo-Valenzuela, Daniel Calderón-González, Zoraida Callejas, David Griol


Abstract
This paper focuses on improving customer service in call centers, where finding accurate answers in the shortest possible time is crucial. The proposed solution is the development of a conversational AI system that acts as a "copilot" for human operators. The main goal of this copilot is to assist the operator in real time by providing conversation summaries, relevant domain information, and suggested responses that help guide the interaction toward a successful resolution. To achieve this, different approaches to Retrieval Augmented Generation (RAG) have been explored. The proposed agentic-RAG architecture integrates multiple autonomous agents for routing, retrieval validation, and response generation, achieving consistent improvements in real-time performance, grounding, and overall user experience across diverse service scenarios. Empirical results with the Action-Based Conversations Dataset (ABCD) corpus show that the use of agents proved to be effective in handling unstructured conversational data. The proposed approach showed an improvement in the quality, relevance, and accuracy of the generated responses with respect to a naïve RAG baseline. It is important to emphasize that this system is not intended to replace the operator, but rather to act as a support tool to enhance efficiency and customer satisfaction.
Anthology ID:
2026.iwsds-1.35
Volume:
Proceedings of the 16th International Workshop on Spoken Dialogue System Technology
Month:
February
Year:
2026
Address:
Trento, Italy
Editors:
Giuseppe Riccardi, Seyed Mahed Mousavi, Maria Ines Torres, Koichiro Yoshino, Zoraida Callejas, Shammur Absar Chowdhury, Yun-Nung Chen, Frederic Bechet, Joakim Gustafson, Géraldine Damnati, Alex Papangelis, Luis Fernando D’Haro, John Mendonça, Raffaella Bernardi, Dilek Hakkani-Tur, Giuseppe "Pino" Di Fabbrizio, Tatsuya Kawahara, Firoj Alam, Gokhan Tur, Michael Johnston
Venue:
IWSDS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
348–356
Language:
URL:
https://aclanthology.org/2026.iwsds-1.35/
DOI:
Bibkey:
Cite (ACL):
Juan Barrionuevo-Valenzuela, Daniel Calderón-González, Zoraida Callejas, and David Griol. 2026. Supporting human operators during customer service interactions with agentic-RAG. In Proceedings of the 16th International Workshop on Spoken Dialogue System Technology, pages 348–356, Trento, Italy. Association for Computational Linguistics.
Cite (Informal):
Supporting human operators during customer service interactions with agentic-RAG (Barrionuevo-Valenzuela et al., IWSDS 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.iwsds-1.35.pdf