<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="roberts-etal-2024-large">
    <titleInfo>
        <title>Large Language Model Recall Uncertainty is Modulated by the Fan Effect</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Jesse</namePart>
        <namePart type="family">Roberts</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Kyle</namePart>
        <namePart type="family">Moore</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Douglas</namePart>
        <namePart type="family">Fisher</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Oseremhen</namePart>
        <namePart type="family">Ewaleifoh</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Thao</namePart>
        <namePart type="family">Pham</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2024-11</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the 28th Conference on Computational Natural Language Learning</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Libby</namePart>
            <namePart type="family">Barak</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Malihe</namePart>
            <namePart type="family">Alikhani</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Miami, FL, USA</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>This paper evaluates whether large language models (LLMs) exhibit cognitive fan effects, similar to those discovered by Anderson in humans, after being pre-trained on human textual data. We conduct two sets of in-context recall experiments designed to elicit fan effects. Consistent with human results, we find that LLM recall uncertainty, measured via token probability, is influenced by the fan effect. Our results show that removing uncertainty disrupts the observed effect. The experiments suggest the fan effect is consistent whether the fan value is induced in-context or in the pre-training data. Finally, these findings provide in-silico evidence that fan effects and typicality are expressions of the same phenomena.</abstract>
    <identifier type="citekey">roberts-etal-2024-large</identifier>
    <location>
        <url>https://aclanthology.org/2024.conll-1.24</url>
    </location>
    <part>
        <date>2024-11</date>
        <extent unit="page">
            <start>303</start>
            <end>313</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T Large Language Model Recall Uncertainty is Modulated by the Fan Effect
%A Roberts, Jesse
%A Moore, Kyle
%A Fisher, Douglas
%A Ewaleifoh, Oseremhen
%A Pham, Thao
%Y Barak, Libby
%Y Alikhani, Malihe
%S Proceedings of the 28th Conference on Computational Natural Language Learning
%D 2024
%8 November
%I Association for Computational Linguistics
%C Miami, FL, USA
%F roberts-etal-2024-large
%X This paper evaluates whether large language models (LLMs) exhibit cognitive fan effects, similar to those discovered by Anderson in humans, after being pre-trained on human textual data. We conduct two sets of in-context recall experiments designed to elicit fan effects. Consistent with human results, we find that LLM recall uncertainty, measured via token probability, is influenced by the fan effect. Our results show that removing uncertainty disrupts the observed effect. The experiments suggest the fan effect is consistent whether the fan value is induced in-context or in the pre-training data. Finally, these findings provide in-silico evidence that fan effects and typicality are expressions of the same phenomena.
%U https://aclanthology.org/2024.conll-1.24
%P 303-313

Markdown (Informal)

[Large Language Model Recall Uncertainty is Modulated by the Fan Effect](https://aclanthology.org/2024.conll-1.24) (Roberts et al., CoNLL 2024)

• Large Language Model Recall Uncertainty is Modulated by the Fan Effect (Roberts et al., CoNLL 2024)

ACL

• Jesse Roberts, Kyle Moore, Douglas Fisher, Oseremhen Ewaleifoh, and Thao Pham. 2024. Large Language Model Recall Uncertainty is Modulated by the Fan Effect. In Proceedings of the 28th Conference on Computational Natural Language Learning, pages 303–313, Miami, FL, USA. Association for Computational Linguistics.