<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="ishigaki-etal-2024-knowledge">
    <titleInfo>
        <title>Knowledge Editing of Large Language Models Unconstrained by Word Order</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Ryoma</namePart>
        <namePart type="family">Ishigaki</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Jundai</namePart>
        <namePart type="family">Suzuki</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Masaki</namePart>
        <namePart type="family">Shuzo</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Eisaku</namePart>
        <namePart type="family">Maeda</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2024-08</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 4: Student Research Workshop)</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Xiyan</namePart>
            <namePart type="family">Fu</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Eve</namePart>
            <namePart type="family">Fleisig</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Bangkok, Thailand</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>Large Language Models (LLMs) are considered to have potentially extensive knowledge, but because their internal processing is black-boxed, it has been difficult to directly edit the knowledge held by the LLMs themselves. To address this issue, a method called local modification-based knowledge editing has been developed. This method identifies the knowledge neurons that encode the target knowledge and adjusts the parameters associated with these neurons to update the knowledge. Knowledge neurons are identified by masking the o part from sentences representing relational triplets (s, r, o), having the LLM predict the masked part, and observing the LLM‘s activation during the prediction. When the architecture is decoder-based, the predicted o needs to be located at the end of the sentence. Previous local modification-based knowledge editing methods for decoder-based models have assumed SVO languages and faced challenges when applied to SOV languages such as Japanese. In this study, we propose a knowledge editing method that eliminates the need for word order constraints by converting the input for identifying knowledge neurons into a question where o is the answer. We conducted validation experiments on 500 examples and confirmed that the proposed method is effective for Japanese, a non-SVO language. We also applied this method to English, an SVO language, and demonstrated that it outperforms conventional methods.</abstract>
    <identifier type="citekey">ishigaki-etal-2024-knowledge</identifier>
    <identifier type="doi">10.18653/v1/2024.acl-srw.23</identifier>
    <location>
        <url>https://aclanthology.org/2024.luhme-srw.23/</url>
    </location>
    <part>
        <date>2024-08</date>
        <extent unit="page">
            <start>159</start>
            <end>169</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T Knowledge Editing of Large Language Models Unconstrained by Word Order
%A Ishigaki, Ryoma
%A Suzuki, Jundai
%A Shuzo, Masaki
%A Maeda, Eisaku
%Y Fu, Xiyan
%Y Fleisig, Eve
%S Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 4: Student Research Workshop)
%D 2024
%8 August
%I Association for Computational Linguistics
%C Bangkok, Thailand
%F ishigaki-etal-2024-knowledge
%X Large Language Models (LLMs) are considered to have potentially extensive knowledge, but because their internal processing is black-boxed, it has been difficult to directly edit the knowledge held by the LLMs themselves. To address this issue, a method called local modification-based knowledge editing has been developed. This method identifies the knowledge neurons that encode the target knowledge and adjusts the parameters associated with these neurons to update the knowledge. Knowledge neurons are identified by masking the o part from sentences representing relational triplets (s, r, o), having the LLM predict the masked part, and observing the LLM‘s activation during the prediction. When the architecture is decoder-based, the predicted o needs to be located at the end of the sentence. Previous local modification-based knowledge editing methods for decoder-based models have assumed SVO languages and faced challenges when applied to SOV languages such as Japanese. In this study, we propose a knowledge editing method that eliminates the need for word order constraints by converting the input for identifying knowledge neurons into a question where o is the answer. We conducted validation experiments on 500 examples and confirmed that the proposed method is effective for Japanese, a non-SVO language. We also applied this method to English, an SVO language, and demonstrated that it outperforms conventional methods.
%R 10.18653/v1/2024.acl-srw.23
%U https://aclanthology.org/2024.luhme-srw.23/
%U https://doi.org/10.18653/v1/2024.acl-srw.23
%P 159-169

Markdown (Informal)

[Knowledge Editing of Large Language Models Unconstrained by Word Order](https://aclanthology.org/2024.luhme-srw.23/) (Ishigaki et al., ACL 2024)

• Knowledge Editing of Large Language Models Unconstrained by Word Order (Ishigaki et al., ACL 2024)

ACL

• Ryoma Ishigaki, Jundai Suzuki, Masaki Shuzo, and Eisaku Maeda. 2024. Knowledge Editing of Large Language Models Unconstrained by Word Order. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 4: Student Research Workshop), pages 159–169, Bangkok, Thailand. Association for Computational Linguistics.