Exploring Prompt-based Multi-task Learning for Multimodal Dialog State Tracking and Immersive Multimodal Conversation

Exploring Prompt-based Multi-task Learning for Multimodal Dialog State Tracking and Immersive Multimodal Conversation Yirong Chen author Ya Li author Tao Wang author Xiaofen Xing author Xiangmin Xu author Quan Liu author Cong Liu author Guoping Hu author 2023-09 text Proceedings of the Eleventh Dialog System Technology Challenge Yun-Nung Chen editor Paul Crook editor Michel Galley editor Sarik Ghazarian editor Chulaka Gunasekara editor Raghav Gupta editor Behnam Hedayatnia editor Satwik Kottur editor Seungwhan Moon editor Chen Zhang editor Association for Computational Linguistics Prague, Czech Republic conference publication chen-etal-2023-exploring-prompt https://aclanthology.org/2023.dstc-1.1/ 2023-09 1 8 Multi-Task Learning for Ambiguous Candidate Identification with Pre-trained Model Daesik Jang author Hyewon Choi author 2023-09 text Proceedings of the Eleventh Dialog System Technology Challenge Yun-Nung Chen editor Paul Crook editor Michel Galley editor Sarik Ghazarian editor Chulaka Gunasekara editor Raghav Gupta editor Behnam Hedayatnia editor Satwik Kottur editor Seungwhan Moon editor Chen Zhang editor Association for Computational Linguistics Prague, Czech Republic conference publication jang-choi-2023-multi https://aclanthology.org/2023.dstc-1.2/ 2023-09 9 14 Improving Situated Conversational Agents with Step-by-Step Multi-modal Logic Reasoning Yuxing Long author Huibin Zhang author Binyuan Hui author Zhenglu Yang author Caixia Yuan author Xiaojie Wang author Fei Huang author Yongbin Li author 2023-09 text Proceedings of the Eleventh Dialog System Technology Challenge Yun-Nung Chen editor Paul Crook editor Michel Galley editor Sarik Ghazarian editor Chulaka Gunasekara editor Raghav Gupta editor Behnam Hedayatnia editor Satwik Kottur editor Seungwhan Moon editor Chen Zhang editor Association for Computational Linguistics Prague, Czech Republic conference publication long-etal-2023-improving https://aclanthology.org/2023.dstc-1.3/ 2023-09 15 24 Contrastively Pretrained Vision-Language Transformers and Domain Adaptation Methods for Multimodal TOD Systems Youngjae Chang author Doo Young Kim author Jinyoung Kim author Keunha Kim author Hyunmook Cha author Suyoung Min author Youngjoong Ko author Kye-Hwan Lee author Joonwoo Park author 2023-09 text Proceedings of the Eleventh Dialog System Technology Challenge Yun-Nung Chen editor Paul Crook editor Michel Galley editor Sarik Ghazarian editor Chulaka Gunasekara editor Raghav Gupta editor Behnam Hedayatnia editor Satwik Kottur editor Seungwhan Moon editor Chen Zhang editor Association for Computational Linguistics Prague, Czech Republic conference publication chang-etal-2023-contrastively https://aclanthology.org/2023.dstc-1.4/ 2023-09 25 30 Multi-Stage Coarse-to-Fine Contrastive Learning for Conversation Intent Induction Caiyuan Chu author Ya Li author Yifan Liu author Jia-Chen Gu author Quan Liu author Yongxin Ge author Guoping Hu author 2023-09 text Proceedings of the Eleventh Dialog System Technology Challenge Yun-Nung Chen editor Paul Crook editor Michel Galley editor Sarik Ghazarian editor Chulaka Gunasekara editor Raghav Gupta editor Behnam Hedayatnia editor Satwik Kottur editor Seungwhan Moon editor Chen Zhang editor Association for Computational Linguistics Prague, Czech Republic conference publication chu-etal-2023-multi https://aclanthology.org/2023.dstc-1.5/ 2023-09 31 39 DORIC : Domain Robust Fine-Tuning for Open Intent Clustering through Dependency Parsing Jihyun Lee author Seungyeon Seo author Yunsu Kim author Gary Geunbae Lee author 2023-09 text Proceedings of the Eleventh Dialog System Technology Challenge Yun-Nung Chen editor Paul Crook editor Michel Galley editor Sarik Ghazarian editor Chulaka Gunasekara editor Raghav Gupta editor Behnam Hedayatnia editor Satwik Kottur editor Seungwhan Moon editor Chen Zhang editor Association for Computational Linguistics Prague, Czech Republic conference publication lee-etal-2023-doric https://aclanthology.org/2023.dstc-1.6/ 2023-09 40 47 A Two-Stage Progressive Intent Clustering for Task-Oriented Dialogue Bingzhu Du author Nan Su author Yuchi Zhang author Yongliang Wang author 2023-09 text Proceedings of the Eleventh Dialog System Technology Challenge Yun-Nung Chen editor Paul Crook editor Michel Galley editor Sarik Ghazarian editor Chulaka Gunasekara editor Raghav Gupta editor Behnam Hedayatnia editor Satwik Kottur editor Seungwhan Moon editor Chen Zhang editor Association for Computational Linguistics Prague, Czech Republic conference publication du-etal-2023-two https://aclanthology.org/2023.dstc-1.7/ 2023-09 48 56 Analysis of Utterance Embeddings and Clustering Methods Related to Intent Induction for Task-Oriented Dialogue Jeiyoon Park author Yoonna Jang author Chanhee Lee author Heuiseok Lim author 2023-09 text Proceedings of the Eleventh Dialog System Technology Challenge Yun-Nung Chen editor Paul Crook editor Michel Galley editor Sarik Ghazarian editor Chulaka Gunasekara editor Raghav Gupta editor Behnam Hedayatnia editor Satwik Kottur editor Seungwhan Moon editor Chen Zhang editor Association for Computational Linguistics Prague, Czech Republic conference publication park-etal-2023-analysis https://aclanthology.org/2023.dstc-1.8/ 2023-09 57 66 Multi-View Zero-Shot Open Intent Induction from Dialogues: Multi Domain Batch and Proxy Gradient Transfer Hyukhun Koh author Haesung Pyun author Nakyeong Yang author Kyomin Jung author 2023-09 text Proceedings of the Eleventh Dialog System Technology Challenge Yun-Nung Chen editor Paul Crook editor Michel Galley editor Sarik Ghazarian editor Chulaka Gunasekara editor Raghav Gupta editor Behnam Hedayatnia editor Satwik Kottur editor Seungwhan Moon editor Chen Zhang editor Association for Computational Linguistics Prague, Czech Republic conference publication koh-etal-2023-multi https://aclanthology.org/2023.dstc-1.9/ 2023-09 67 80 Adapting Text-based Dialogue State Tracker for Spoken Dialogues Jaeseok Yoon author Seunghyun Hwang author Han Ran author Jeong-Uk Bang author Kee-Eung Kim author 2023-09 text Proceedings of the Eleventh Dialog System Technology Challenge Yun-Nung Chen editor Paul Crook editor Michel Galley editor Sarik Ghazarian editor Chulaka Gunasekara editor Raghav Gupta editor Behnam Hedayatnia editor Satwik Kottur editor Seungwhan Moon editor Chen Zhang editor Association for Computational Linguistics Prague, Czech Republic conference publication yoon-etal-2023-adapting https://aclanthology.org/2023.dstc-1.10/ 2023-09 81 88 CopyT5: Copy Mechanism and Post-Trained T5 for Speech-Aware Dialogue State Tracking System Cheonyoung Park author Eunji Ha author Yewon Jeong author Chi-young Kim author Haeun Yu author Joo-won Sung author 2023-09 text Proceedings of the Eleventh Dialog System Technology Challenge Yun-Nung Chen editor Paul Crook editor Michel Galley editor Sarik Ghazarian editor Chulaka Gunasekara editor Raghav Gupta editor Behnam Hedayatnia editor Satwik Kottur editor Seungwhan Moon editor Chen Zhang editor Association for Computational Linguistics Prague, Czech Republic conference publication park-etal-2023-copyt5 https://aclanthology.org/2023.dstc-1.11/ 2023-09 89 94 OLISIA: a Cascade System for Spoken Dialogue State Tracking Léo Jacqmin author Lucas Druart author Yannick Estève author Benoît Favre author Lina M Rojas author Valentin Vielzeuf author 2023-09 text Proceedings of the Eleventh Dialog System Technology Challenge Yun-Nung Chen editor Paul Crook editor Michel Galley editor Sarik Ghazarian editor Chulaka Gunasekara editor Raghav Gupta editor Behnam Hedayatnia editor Satwik Kottur editor Seungwhan Moon editor Chen Zhang editor Association for Computational Linguistics Prague, Czech Republic conference publication jacqmin-etal-2023-olisia https://aclanthology.org/2023.dstc-1.12/ 2023-09 95 104 Speech-Aware Multi-Domain Dialogue State Generation with ASR Error Correction Modules Ridong Jiang author Wei Shi author Bin Wang author Chen Zhang author Yan Zhang author Chunlei Pan author Jung Jae Kim author Haizhou Li author 2023-09 text Proceedings of the Eleventh Dialog System Technology Challenge Yun-Nung Chen editor Paul Crook editor Michel Galley editor Sarik Ghazarian editor Chulaka Gunasekara editor Raghav Gupta editor Behnam Hedayatnia editor Satwik Kottur editor Seungwhan Moon editor Chen Zhang editor Association for Computational Linguistics Prague, Czech Republic conference publication jiang-etal-2023-speech https://aclanthology.org/2023.dstc-1.13/ 2023-09 105 112 Three Ways of Using Large Language Models to Evaluate Chat Ondřej Plátek author Vojtech Hudecek author Patricia Schmidtova author Mateusz Lango author Ondrej Dusek author 2023-09 text Proceedings of the Eleventh Dialog System Technology Challenge Yun-Nung Chen editor Paul Crook editor Michel Galley editor Sarik Ghazarian editor Chulaka Gunasekara editor Raghav Gupta editor Behnam Hedayatnia editor Satwik Kottur editor Seungwhan Moon editor Chen Zhang editor Association for Computational Linguistics Prague, Czech Republic conference publication platek-etal-2023-three https://aclanthology.org/2023.dstc-1.14/ 2023-09 113 122 Parallel Corpora Alignment Framework for Multilingual and Robust Automatic Dialogue Evaluation Xinglin Wang author Jiayi Shi author Peiwen Yuan author Kan Li author 2023-09 text Proceedings of the Eleventh Dialog System Technology Challenge Yun-Nung Chen editor Paul Crook editor Michel Galley editor Sarik Ghazarian editor Chulaka Gunasekara editor Raghav Gupta editor Behnam Hedayatnia editor Satwik Kottur editor Seungwhan Moon editor Chen Zhang editor Association for Computational Linguistics Prague, Czech Republic conference publication wang-etal-2023-parallel https://aclanthology.org/2023.dstc-1.15/ 2023-09 123 132 Simple LLM Prompting is State-of-the-Art for Robust and Multilingual Dialogue Evaluation John Mendonça author Patrícia Pereira author Helena Moniz author Joao Paulo Carvalho author Alon Lavie author Isabel Trancoso author 2023-09 text Proceedings of the Eleventh Dialog System Technology Challenge Yun-Nung Chen editor Paul Crook editor Michel Galley editor Sarik Ghazarian editor Chulaka Gunasekara editor Raghav Gupta editor Behnam Hedayatnia editor Satwik Kottur editor Seungwhan Moon editor Chen Zhang editor Association for Computational Linguistics Prague, Czech Republic conference publication mendonca-etal-2023-simple https://aclanthology.org/2023.dstc-1.16/ 2023-09 133 143 Towards Optimizing Pre-trained Language Model Ensemble Learning for Task-oriented Dialogue System Zhiyuan Zhu author Yusheng Liao author Zhe Chen author Yu Wang author Yunfeng Guan author 2023-09 text Proceedings of the Eleventh Dialog System Technology Challenge Yun-Nung Chen editor Paul Crook editor Michel Galley editor Sarik Ghazarian editor Chulaka Gunasekara editor Raghav Gupta editor Behnam Hedayatnia editor Satwik Kottur editor Seungwhan Moon editor Chen Zhang editor Association for Computational Linguistics Prague, Czech Republic conference publication zhu-etal-2023-towards-optimizing https://aclanthology.org/2023.dstc-1.17/ 2023-09 144 149 Enhancing Task-Oriented Dialog System with Subjective Knowledge: A Large Language Model-based Data Augmentation Framework Haein Jung author Heuiyeen Yeen author Jeehyun Lee author Minju Kim author Namo Bang author Myoung-Wan Koo author 2023-09 text Proceedings of the Eleventh Dialog System Technology Challenge Yun-Nung Chen editor Paul Crook editor Michel Galley editor Sarik Ghazarian editor Chulaka Gunasekara editor Raghav Gupta editor Behnam Hedayatnia editor Satwik Kottur editor Seungwhan Moon editor Chen Zhang editor Association for Computational Linguistics Prague, Czech Republic conference publication jung-etal-2023-enhancing https://aclanthology.org/2023.dstc-1.18/ 2023-09 150 165 Semantic data augmentation for meaning maintenance on Task-Oriented Conversation with Large-size Language Model Jaehwan Lee author Kwanyoung Son author Eugene Kim author 2023-09 text Proceedings of the Eleventh Dialog System Technology Challenge Yun-Nung Chen editor Paul Crook editor Michel Galley editor Sarik Ghazarian editor Chulaka Gunasekara editor Raghav Gupta editor Behnam Hedayatnia editor Satwik Kottur editor Seungwhan Moon editor Chen Zhang editor Association for Computational Linguistics Prague, Czech Republic conference publication lee-etal-2023-semantic https://aclanthology.org/2023.dstc-1.19/ 2023-09 166 176 Ensemble Method via Ranking Model for Conversational Modeling with Subjective Knowledge Xin Huang author Kye Min Tan author Richeng Duan author Bowei Zou author 2023-09 text Proceedings of the Eleventh Dialog System Technology Challenge Yun-Nung Chen editor Paul Crook editor Michel Galley editor Sarik Ghazarian editor Chulaka Gunasekara editor Raghav Gupta editor Behnam Hedayatnia editor Satwik Kottur editor Seungwhan Moon editor Chen Zhang editor Association for Computational Linguistics Prague, Czech Republic conference publication huang-etal-2023-ensemble https://aclanthology.org/2023.dstc-1.20/ 2023-09 177 184 Exploring Back Translation with Typo Noise for Enhanced Inquiry Understanding in Task-Oriented Dialogue Jihyun Lee author Junseok Kim author Gary Geunbae Lee author 2023-09 text Proceedings of the Eleventh Dialog System Technology Challenge Yun-Nung Chen editor Paul Crook editor Michel Galley editor Sarik Ghazarian editor Chulaka Gunasekara editor Raghav Gupta editor Behnam Hedayatnia editor Satwik Kottur editor Seungwhan Moon editor Chen Zhang editor Association for Computational Linguistics Prague, Czech Republic conference publication lee-etal-2023-exploring https://aclanthology.org/2023.dstc-1.21/ 2023-09 185 192 Leveraging Few-Shot Data Augmentation and Waterfall Prompting for Response Generation Lea Krause author Selene Báez Santamaría author Michiel van der Meer author Urja Khurana author 2023-09 text Proceedings of the Eleventh Dialog System Technology Challenge Yun-Nung Chen editor Paul Crook editor Michel Galley editor Sarik Ghazarian editor Chulaka Gunasekara editor Raghav Gupta editor Behnam Hedayatnia editor Satwik Kottur editor Seungwhan Moon editor Chen Zhang editor Association for Computational Linguistics Prague, Czech Republic conference publication krause-etal-2023-leveraging https://aclanthology.org/2023.dstc-1.22/ 2023-09 193 205 Leveraging Ensemble Techniques and Metadata for Subjective Knowledge-grounded Conversational Systems Seongho Joo author Kang-il Lee author Kyungmin Min author Joongbo Shin author Janghoon Han author Seungpil Won author Kyomin Jung author 2023-09 text Proceedings of the Eleventh Dialog System Technology Challenge Yun-Nung Chen editor Paul Crook editor Michel Galley editor Sarik Ghazarian editor Chulaka Gunasekara editor Raghav Gupta editor Behnam Hedayatnia editor Satwik Kottur editor Seungwhan Moon editor Chen Zhang editor Association for Computational Linguistics Prague, Czech Republic conference publication joo-etal-2023-leveraging https://aclanthology.org/2023.dstc-1.23/ 2023-09 206 215 A Difference-aware Ensemble Method for Task-oriented Dialogue with Subjective Knowledge Changxin Ke author Churui Sun author Longxuan Ma author Wei-Nan Zhang author Ting Liu author 2023-09 text Proceedings of the Eleventh Dialog System Technology Challenge Yun-Nung Chen editor Paul Crook editor Michel Galley editor Sarik Ghazarian editor Chulaka Gunasekara editor Raghav Gupta editor Behnam Hedayatnia editor Satwik Kottur editor Seungwhan Moon editor Chen Zhang editor Association for Computational Linguistics Prague, Czech Republic conference publication ke-etal-2023-difference https://aclanthology.org/2023.dstc-1.24/ 2023-09 216 225 DSTC-11: Speech Aware Task-Oriented Dialog Modeling Track Hagen Soltau author Izhak Shafran author Mingqiu Wang author Abhinav Rastogi author Wei Han author Yuan Cao author 2023-09 text Proceedings of the Eleventh Dialog System Technology Challenge Yun-Nung Chen editor Paul Crook editor Michel Galley editor Sarik Ghazarian editor Chulaka Gunasekara editor Raghav Gupta editor Behnam Hedayatnia editor Satwik Kottur editor Seungwhan Moon editor Chen Zhang editor Association for Computational Linguistics Prague, Czech Republic conference publication soltau-etal-2023-dstc https://aclanthology.org/2023.dstc-1.25/ 2023-09 226 234 Overview of Situated and Interactive Multimodal Conversations (SIMMC) 2.1 Track at DSTC 11 Satwik Kottur author Seungwhan Moon author 2023-09 text Proceedings of the Eleventh Dialog System Technology Challenge Yun-Nung Chen editor Paul Crook editor Michel Galley editor Sarik Ghazarian editor Chulaka Gunasekara editor Raghav Gupta editor Behnam Hedayatnia editor Satwik Kottur editor Seungwhan Moon editor Chen Zhang editor Association for Computational Linguistics Prague, Czech Republic conference publication kottur-moon-2023-overview https://aclanthology.org/2023.dstc-1.26/ 2023-09 235 241 Intent Induction from Conversations for Task-Oriented Dialogue Track at DSTC 11 James Gung author Raphael Shu author Emily Moeng author Wesley Rose author Salvatore Romeo author Arshit Gupta author Yassine Benajiba author Saab Mansour author Yi Zhang author 2023-09 text Proceedings of the Eleventh Dialog System Technology Challenge Yun-Nung Chen editor Paul Crook editor Michel Galley editor Sarik Ghazarian editor Chulaka Gunasekara editor Raghav Gupta editor Behnam Hedayatnia editor Satwik Kottur editor Seungwhan Moon editor Chen Zhang editor Association for Computational Linguistics Prague, Czech Republic conference publication gung-etal-2023-intent https://aclanthology.org/2023.dstc-1.27/ 2023-09 242 259 Overview of Robust and Multilingual Automatic Evaluation Metricsfor Open-Domain Dialogue Systems at DSTC 11 Track 4 Mario Rodríguez-Cantelar author Chen Zhang author Chengguang Tang author Ke Shi author Sarik Ghazarian author João Sedoc author Luis Fernando D’Haro author Alexander I Rudnicky author 2023-09 text Proceedings of the Eleventh Dialog System Technology Challenge Yun-Nung Chen editor Paul Crook editor Michel Galley editor Sarik Ghazarian editor Chulaka Gunasekara editor Raghav Gupta editor Behnam Hedayatnia editor Satwik Kottur editor Seungwhan Moon editor Chen Zhang editor Association for Computational Linguistics Prague, Czech Republic conference publication rodriguez-cantelar-etal-2023-overview https://aclanthology.org/2023.dstc-1.28/ 2023-09 260 273 Task-Oriented Conversational Modeling with Subjective Knowledge Track in DSTC11 Seokhwan Kim author Spandana Gella author Chao Zhao author Di Jin author Alexandros Papangelis author Behnam Hedayatnia author Yang Liu author Dilek Z Hakkani-Tur author 2023-09 text Proceedings of the Eleventh Dialog System Technology Challenge Yun-Nung Chen editor Paul Crook editor Michel Galley editor Sarik Ghazarian editor Chulaka Gunasekara editor Raghav Gupta editor Behnam Hedayatnia editor Satwik Kottur editor Seungwhan Moon editor Chen Zhang editor Association for Computational Linguistics Prague, Czech Republic conference publication kim-etal-2023-task https://aclanthology.org/2023.dstc-1.29/ 2023-09 274 281