Injecting Comparison Skills in Task-Oriented Dialogue Systems for Database Search Results Disambiguation

Yongil Kim, Yerin Hwang, Joongbo Shin, Hyunkyung Bae, Kyomin Jung


Abstract
In task-oriented dialogue (TOD) systems designed to aid users accomplish specific goals in one or more domains, the agent retrieves entities that satisfy user constraints from the database. However, when multiple database search results exist, an ambiguity occurs regarding which results to select and present to the user. Existing TOD systems handle this ambiguity by randomly selecting one or few results and presenting their names to the user. However, in a real scenario, users do not always accept a randomly recommended entity, and users should have access to more comprehensive information about the search results. To address this limitation, we propose a novel task called Comparison-Based database search Ambiguity handling (CBA), which handles ambiguity in database search results by comparing the properties of multiple entities to enable users to choose according to their preferences. Accordingly, we introduce a new framework for automatically collecting high-quality dialogue data along with the Disambiguating Schema-guided Dialogue (DSD) dataset, an augmented version of the SGD dataset. Experimental studies on the DSD dataset demonstrate that training baseline models with the dataset effectively address the CBA task. Our dataset and code will be publicized.
Anthology ID:
2023.findings-acl.249
Volume:
Findings of the Association for Computational Linguistics: ACL 2023
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Anna Rogers, Jordan Boyd-Graber, Naoaki Okazaki
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
4047–4065
Language:
URL:
https://aclanthology.org/2023.findings-acl.249
DOI:
10.18653/v1/2023.findings-acl.249
Bibkey:
Cite (ACL):
Yongil Kim, Yerin Hwang, Joongbo Shin, Hyunkyung Bae, and Kyomin Jung. 2023. Injecting Comparison Skills in Task-Oriented Dialogue Systems for Database Search Results Disambiguation. In Findings of the Association for Computational Linguistics: ACL 2023, pages 4047–4065, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
Injecting Comparison Skills in Task-Oriented Dialogue Systems for Database Search Results Disambiguation (Kim et al., Findings 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.findings-acl.249.pdf