Zesen Cheng
2023
AutoConv: Automatically Generating Information-seeking Conversations with Large Language Models
Siheng Li
|
Cheng Yang
|
Yichun Yin
|
Xinyu Zhu
|
Zesen Cheng
|
Lifeng Shang
|
Xin Jiang
|
Qun Liu
|
Yujiu Yang
Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)
Information-seeking conversation, which aims to help users gather information through conversation, has achieved great progress in recent years. However, the research is still stymied by the scarcity of training data. To alleviate this problem, we propose AutoConv for synthetic conversation generation, which takes advantage of the few-shot learning ability and generation capacity of large language models (LLM). Specifically, we formulate the conversation generation problem as a language modeling task, then finetune an LLM with a few human conversations to capture the characteristics of the information-seeking process and use it for generating synthetic conversations with high quality. Experimental results on two frequently-used datasets verify that AutoConv has substantial improvements over strong baselines and alleviates the dependence on human annotation. In addition, we also provide several analysis studies to promote future research.
NewsDialogues: Towards Proactive News Grounded Conversation
Siheng Li
|
Yichun Yin
|
Cheng Yang
|
Wangjie Jiang
|
Yiwei Li
|
Zesen Cheng
|
Lifeng Shang
|
Xin Jiang
|
Qun Liu
|
Yujiu Yang
Findings of the Association for Computational Linguistics: ACL 2023
Hot news is one of the most popular topics in daily conversations. However, news grounded conversation has long been stymied by the lack of well-designed task definition and scarce data. In this paper, we propose a novel task, Proactive News Grounded Conversation, in which a dialogue system can proactively lead the conversation based on some key topics of the news. In addition, both information-seeking and chit-chat scenarios are included realistically, where the user may ask a series of questions about the news details or express their opinions and be eager to chat. To further develop this novel task, we collect a human-to-human Chinese dialogue dataset NewsDialogues, which includes 1K conversations with a total of 14.6K utterances and detailed annotations for target topics and knowledge spans. Furthermore, we propose a method named Predict-Generate-Rank, consisting of a generator for grounded knowledge prediction and response generation, and a ranker for the ranking of multiple responses to alleviate the exposure bias. We conduct comprehensive experiments to demonstrate the effectiveness of the proposed method and further present several key findings and challenges to prompt future research.
Search
Co-authors
- Siheng Li 2
- Cheng Yang 2
- Yichun Yin 2
- Lifeng Shang 2
- Xin Jiang 2
- show all...