<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="lewis-white-2023-mitigating">
    <titleInfo>
        <title>Mitigating Harms of LLMs via Knowledge Distillation for a Virtual Museum Tour Guide</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Ashley</namePart>
        <namePart type="family">Lewis</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Michael</namePart>
        <namePart type="family">White</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2023-09</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the 1st Workshop on Taming Large Language Models: Controllability in the era of Interactive Assistants!</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Devamanyu</namePart>
            <namePart type="family">Hazarika</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Xiangru</namePart>
            <namePart type="given">Robert</namePart>
            <namePart type="family">Tang</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Di</namePart>
            <namePart type="family">Jin</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Prague, Czech Republic</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>LLMs are known to be very powerful, exhibiting both great benefits and great risk. We seek to leverage the benefits, in particular the ability to be fluent, conversational dialogue agents, while minimizing the risks, such as hallucination and toxic content. In this work we use knowledge distillation to create a virtual museum tour guide dialogue agent, employing ChatGPT as a teacher model for a smaller student model, T5-large. We find the T5 model shows competitive performance, significantly reduces instances of hallucination, and shows promise for reducing toxic content.</abstract>
    <identifier type="citekey">lewis-white-2023-mitigating</identifier>
    <location>
        <url>https://aclanthology.org/2023.tllm-1.4</url>
    </location>
    <part>
        <date>2023-09</date>
        <extent unit="page">
            <start>31</start>
            <end>45</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T Mitigating Harms of LLMs via Knowledge Distillation for a Virtual Museum Tour Guide
%A Lewis, Ashley
%A White, Michael
%Y Hazarika, Devamanyu
%Y Tang, Xiangru Robert
%Y Jin, Di
%S Proceedings of the 1st Workshop on Taming Large Language Models: Controllability in the era of Interactive Assistants!
%D 2023
%8 September
%I Association for Computational Linguistics
%C Prague, Czech Republic
%F lewis-white-2023-mitigating
%X LLMs are known to be very powerful, exhibiting both great benefits and great risk. We seek to leverage the benefits, in particular the ability to be fluent, conversational dialogue agents, while minimizing the risks, such as hallucination and toxic content. In this work we use knowledge distillation to create a virtual museum tour guide dialogue agent, employing ChatGPT as a teacher model for a smaller student model, T5-large. We find the T5 model shows competitive performance, significantly reduces instances of hallucination, and shows promise for reducing toxic content.
%U https://aclanthology.org/2023.tllm-1.4
%P 31-45

Markdown (Informal)

[Mitigating Harms of LLMs via Knowledge Distillation for a Virtual Museum Tour Guide](https://aclanthology.org/2023.tllm-1.4) (Lewis & White, TLLM-WS 2023)

• Mitigating Harms of LLMs via Knowledge Distillation for a Virtual Museum Tour Guide (Lewis & White, TLLM-WS 2023)

ACL

• Ashley Lewis and Michael White. 2023. Mitigating Harms of LLMs via Knowledge Distillation for a Virtual Museum Tour Guide. In Proceedings of the 1st Workshop on Taming Large Language Models: Controllability in the era of Interactive Assistants!, pages 31–45, Prague, Czech Republic. Association for Computational Linguistics.