<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="lou-etal-2024-large">
    <titleInfo>
        <title>Large Language Model Instruction Following: A Survey of Progresses and Challenges</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Renze</namePart>
        <namePart type="family">Lou</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Kai</namePart>
        <namePart type="family">Zhang</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Wenpeng</namePart>
        <namePart type="family">Yin</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2024-09</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <genre authority="bibutilsgt">journal article</genre>
    <relatedItem type="host">
        <titleInfo>
            <title>Computational Linguistics</title>
        </titleInfo>
        <originInfo>
            <issuance>continuing</issuance>
            <publisher>MIT Press</publisher>
            <place>
                <placeTerm type="text">Cambridge, MA</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">periodical</genre>
        <genre authority="bibutilsgt">academic journal</genre>
    </relatedItem>
    <abstract>Task semantics can be expressed by a set of input-output examples or a piece of textual instruction. Conventional machine learning approaches for natural language processing (NLP) mainly rely on the availability of large-scale sets of task-specific examples. Two issues arise: First, collecting task-specific labeled examples does not apply to scenarios where tasks may be too complicated or costly to annotate, or the system is required to handle a new task immediately; second, this is not user-friendly since end-users are probably more willing to provide task description rather than a set of examples before using the system. Therefore, the community is paying increasing interest in a new supervision-seeking paradigm for NLP: learning to follow task instructions, that is, instruction following. Despite its impressive progress, there are some unsolved research equations that the community struggles with. This survey tries to summarize and provide insights into the current research on instruction following, particularly, by answering the following questions: (i) What is task instruction, and what instruction types exist? (ii) How should we model instructions? (iii) What are popular instruction following datasets and evaluation metrics? (iv) What factors influence and explain the instructions’ performance? (v) What challenges remain in instruction following? To our knowledge, this is the first comprehensive survey about instruction following.1</abstract>
    <identifier type="citekey">lou-etal-2024-large</identifier>
    <identifier type="doi">10.1162/coli_a_00523</identifier>
    <location>
        <url>https://aclanthology.org/2024.cl-3.7</url>
    </location>
    <part>
        <date>2024-09</date>
        <detail type="volume"><number>50</number></detail>
        <detail type="issue"><number>3</number></detail>
        <extent unit="page">
            <start>1053</start>
            <end>1095</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Journal Article
%T Large Language Model Instruction Following: A Survey of Progresses and Challenges
%A Lou, Renze
%A Zhang, Kai
%A Yin, Wenpeng
%J Computational Linguistics
%D 2024
%8 September
%V 50
%N 3
%I MIT Press
%C Cambridge, MA
%F lou-etal-2024-large
%X Task semantics can be expressed by a set of input-output examples or a piece of textual instruction. Conventional machine learning approaches for natural language processing (NLP) mainly rely on the availability of large-scale sets of task-specific examples. Two issues arise: First, collecting task-specific labeled examples does not apply to scenarios where tasks may be too complicated or costly to annotate, or the system is required to handle a new task immediately; second, this is not user-friendly since end-users are probably more willing to provide task description rather than a set of examples before using the system. Therefore, the community is paying increasing interest in a new supervision-seeking paradigm for NLP: learning to follow task instructions, that is, instruction following. Despite its impressive progress, there are some unsolved research equations that the community struggles with. This survey tries to summarize and provide insights into the current research on instruction following, particularly, by answering the following questions: (i) What is task instruction, and what instruction types exist? (ii) How should we model instructions? (iii) What are popular instruction following datasets and evaluation metrics? (iv) What factors influence and explain the instructions’ performance? (v) What challenges remain in instruction following? To our knowledge, this is the first comprehensive survey about instruction following.1
%R 10.1162/coli_a_00523
%U https://aclanthology.org/2024.cl-3.7
%U https://doi.org/10.1162/coli_a_00523
%P 1053-1095

Markdown (Informal)

[Large Language Model Instruction Following: A Survey of Progresses and Challenges](https://aclanthology.org/2024.cl-3.7) (Lou et al., CL 2024)

• Large Language Model Instruction Following: A Survey of Progresses and Challenges (Lou et al., CL 2024)

ACL

• Renze Lou, Kai Zhang, and Wenpeng Yin. 2024. Large Language Model Instruction Following: A Survey of Progresses and Challenges. Computational Linguistics, 50(3):1053–1095.