mCS-LM: Multimodal Customer Service and Incident Management Systems Based on Large Language Models

Carlos Díaz-Morales, Marcos Checa-Rubio, Tomás Bernal-Beltrán, Ronghao Pan, David Barbáchano, María del Pilar Salas-Zárate, Mario Andrés Paredes-Valverde, Rafael Valencia-Garcia


Abstract
Customer service and incident management increasingly rely on multimodal evidence, combining text, images and audio. However, general-purpose models lack domain grounding, structured output control and reliability guarantees required in regulated enterprise environments, often leading to hallucinated responses and limiting their practical deployment. This paper presents mCS-LM, a multilingual multimodal framework that integrates Large Language Models (LLMs), Visual Language Models (VLMs), Audio Language Models (ALMs) and Retrieval-Augmented Generation (RAG) within a modular and traceable architecture tailored to customer service and incident management. The system introduces complementary processing flows: (i) perception modules for visual and audio understanding aligned with LLM-based reasoning, and (ii) structured report generation from multimodal evidence through supervised fine-tuning using QLoRA and efficient adaptation techniques. To mitigate hallucinations and improve factual reliability, the framework incorporates vector databases and multimodal RAG pipelines that retrieve domain-specific knowledge from external corporate sources. Formal structural schemas and validation mechanisms enforce output consistency and syntactic correctness. The platform is deployed as a web-based system with REST API integration, enabling scalable multimodal interaction across channels such as instant messaging, email and web chat. Experimental results demonstrate that multimodal generative models can be specialized for structured, domain-constrained enterprise tasks while maintaining computational viability and robustness.
Anthology ID:
2026.lanlp-1.6
Volume:
Proceedings of LANLP: Bridging Ibero and Latin American NLP Communities
Month:
May
Year:
2026
Address:
Palma, Mallorca (Spain)
Editors:
German Rigau Claramunt, Pablo Gamallo, Rafael Muñoz Guillena, Luis Chiruzzo, Eugenio Martínez Cámara
Venues:
LANLP | WS
SIG:
Publisher:
ELRA Language Resources Association (ELRA)
Note:
Pages:
38–45
Language:
External URL:
https://lrec.elra.info/lrec2026-ws-lanlp-06
DOI:
10.63317/3tcxy4bkn76p
Bibkey:
Cite (ACL):
Carlos Díaz-Morales, Marcos Checa-Rubio, Tomás Bernal-Beltrán, Ronghao Pan, David Barbáchano, María del Pilar Salas-Zárate, Mario Andrés Paredes-Valverde, and Rafael Valencia-Garcia. 2026. mCS-LM: Multimodal Customer Service and Incident Management Systems Based on Large Language Models. In Proceedings of LANLP: Bridging Ibero and Latin American NLP Communities, pages 38–45, Palma, Mallorca (Spain). ELRA Language Resources Association (ELRA).
Cite (Informal):
mCS-LM: Multimodal Customer Service and Incident Management Systems Based on Large Language Models (Díaz-Morales et al., LANLP 2026)
Copy Citation: