<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="dhole-2024-kaucus">
    <titleInfo>
        <title>KAUCUS - Knowledgeable User Simulators for Training Large Language Models</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Kaustubh</namePart>
        <namePart type="family">Dhole</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2024-03</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the 1st Workshop on Simulating Conversational Intelligence in Chat (SCI-CHAT 2024)</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Yvette</namePart>
            <namePart type="family">Graham</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Qun</namePart>
            <namePart type="family">Liu</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Gerasimos</namePart>
            <namePart type="family">Lampouras</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Ignacio</namePart>
            <namePart type="family">Iacobacci</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Sinead</namePart>
            <namePart type="family">Madden</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Haider</namePart>
            <namePart type="family">Khalid</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Rameez</namePart>
            <namePart type="family">Qureshi</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">St. Julians, Malta</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>An effective multi-turn instruction-following assistant can be developed by creating a simulator that can generate useful interaction data. Apart from relying on its intrinsic weights, an ideal user simulator should also be able to bootstrap external knowledge rapidly in its raw form to simulate the multifarious diversity of text available over the internet. Previous user simulators generally lacked diversity, were mostly closed domain, and necessitated rigid schema making them inefficient to rapidly scale to incorporate external knowledge. In this regard, we introduce Kaucus, a Knowledge-Augmented User Simulator framework, to outline a process of creating diverse user simulators, that can seamlessly exploit external knowledge as well as benefit downstream assistant model training. Through two GPT-J based simulators viz., a Retrieval Augmented Simulator and a Summary Controlled Simulator we generate diverse simulator-assistant interactions. Through reward and preference model-based evaluations, we find that these interactions serve as useful training data and create more helpful downstream assistants. We also find that incorporating knowledge through retrieval augmentation or summary control helps create better assistants.</abstract>
    <identifier type="citekey">dhole-2024-kaucus</identifier>
    <location>
        <url>https://aclanthology.org/2024.scichat-1.5</url>
    </location>
    <part>
        <date>2024-03</date>
        <extent unit="page">
            <start>53</start>
            <end>65</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T KAUCUS - Knowledgeable User Simulators for Training Large Language Models
%A Dhole, Kaustubh
%Y Graham, Yvette
%Y Liu, Qun
%Y Lampouras, Gerasimos
%Y Iacobacci, Ignacio
%Y Madden, Sinead
%Y Khalid, Haider
%Y Qureshi, Rameez
%S Proceedings of the 1st Workshop on Simulating Conversational Intelligence in Chat (SCI-CHAT 2024)
%D 2024
%8 March
%I Association for Computational Linguistics
%C St. Julians, Malta
%F dhole-2024-kaucus
%X An effective multi-turn instruction-following assistant can be developed by creating a simulator that can generate useful interaction data. Apart from relying on its intrinsic weights, an ideal user simulator should also be able to bootstrap external knowledge rapidly in its raw form to simulate the multifarious diversity of text available over the internet. Previous user simulators generally lacked diversity, were mostly closed domain, and necessitated rigid schema making them inefficient to rapidly scale to incorporate external knowledge. In this regard, we introduce Kaucus, a Knowledge-Augmented User Simulator framework, to outline a process of creating diverse user simulators, that can seamlessly exploit external knowledge as well as benefit downstream assistant model training. Through two GPT-J based simulators viz., a Retrieval Augmented Simulator and a Summary Controlled Simulator we generate diverse simulator-assistant interactions. Through reward and preference model-based evaluations, we find that these interactions serve as useful training data and create more helpful downstream assistants. We also find that incorporating knowledge through retrieval augmentation or summary control helps create better assistants.
%U https://aclanthology.org/2024.scichat-1.5
%P 53-65

Markdown (Informal)

[KAUCUS - Knowledgeable User Simulators for Training Large Language Models](https://aclanthology.org/2024.scichat-1.5) (Dhole, SCI-CHAT-WS 2024)

• KAUCUS - Knowledgeable User Simulators for Training Large Language Models (Dhole, SCI-CHAT-WS 2024)

ACL

• Kaustubh Dhole. 2024. KAUCUS - Knowledgeable User Simulators for Training Large Language Models. In Proceedings of the 1st Workshop on Simulating Conversational Intelligence in Chat (SCI-CHAT 2024), pages 53–65, St. Julians, Malta. Association for Computational Linguistics.