Intent Recognition and Out-of-Scope Detection using LLMs in Multi-party Conversations

Galo Castillo-López, Gael de Chalendar, Nasredine Semmar


Abstract
Intent recognition is a fundamental component in task-oriented dialogue systems (TODS). Determining user intents and detecting whether an intent is Out-of-Scope (OOS) is crucial for TODS to provide reliable responses. However, traditional TODS require large amount of annotated data. In this work we propose a hybrid approach to combine BERT and LLMs in zero and few-shot scenarios to recognize intents and detect OOS utterances. Our approach leverages LLMs generalization power and BERT’s computational efficiency in such scenarios. We evaluate our method on multi-party conversation corpora and observe that sharing information from BERT outputs to LLMs lead to system performance improvement.
Anthology ID:
2025.sigdial-1.41
Volume:
Proceedings of the 26th Annual Meeting of the Special Interest Group on Discourse and Dialogue
Month:
August
Year:
2025
Address:
Avignon, France
Editors:
Frédéric Béchet, Fabrice Lefèvre, Nicholas Asher, Seokhwan Kim, Teva Merlin
Venue:
SIGDIAL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
504–512
Language:
URL:
https://aclanthology.org/2025.sigdial-1.41/
DOI:
Bibkey:
Cite (ACL):
Galo Castillo-López, Gael de Chalendar, and Nasredine Semmar. 2025. Intent Recognition and Out-of-Scope Detection using LLMs in Multi-party Conversations. In Proceedings of the 26th Annual Meeting of the Special Interest Group on Discourse and Dialogue, pages 504–512, Avignon, France. Association for Computational Linguistics.
Cite (Informal):
Intent Recognition and Out-of-Scope Detection using LLMs in Multi-party Conversations (Castillo-López et al., SIGDIAL 2025)
Copy Citation:
PDF:
https://aclanthology.org/2025.sigdial-1.41.pdf