A Computational Study of Matrix Decomposition Methods for Compression of Pre-trained Transformers

Sergey Pletenev; Viktoriia Chekalina; Daniil Moskovskiy; Mikhail Seleznev; Sergey Zagoruyko; Alexander Panchenko

A Computational Study of Matrix Decomposition Methods for Compression of Pre-trained Transformers

Sergey Pletenev, Viktoriia Chekalina, Daniil Moskovskiy, Mikhail Seleznev, Sergey Zagoruyko, Alexander Panchenko

Correct Metadata for

Important: The Anthology treat PDFs as authoritative. Please use this form only to correct data that is out of line with the PDF. See our corrections guidelines if you need to change the PDF.

Title Adjust the title. Retain tags such as <fixed-case>.

Authors Adjust author names and order to match the PDF.

Abstract Correct abstract if needed. Retain XML formatting tags such as <tex-math>.

Verification against PDF Ensure that the new title/authors match the snapshot below. (If there is no snapshot or it is too small, consult the PDF.)

Authors concatenated from the text boxes above:

ALL author names match the snapshot above—including middle initials, hyphens, and accents.

Anthology ID:: 2023.paclic-1.73
Volume:: Proceedings of the 37th Pacific Asia Conference on Language, Information and Computation
Month:: December
Year:: 2023
Address:: Hong Kong, China
Editors:: Chu-Ren Huang, Yasunari Harada, Jong-Bok Kim, Si Chen, Yu-Yin Hsu, Emmanuele Chersoni, Pranav A, Winnie Huiheng Zeng, Bo Peng, Yuxi Li, Junlin Li
Venue:: PACLIC
SIG:
Publisher:: Association for Computational Linguistics
Note:
Pages:: 723–742
Language:
URL:: https://aclanthology.org/2023.paclic-1.73/
DOI:
Bibkey:
Cite (ACL):: Sergey Pletenev, Viktoriia Chekalina, Daniil Moskovskiy, Mikhail Seleznev, Sergey Zagoruyko, and Alexander Panchenko. 2023. A Computational Study of Matrix Decomposition Methods for Compression of Pre-trained Transformers. In Proceedings of the 37th Pacific Asia Conference on Language, Information and Computation, pages 723–742, Hong Kong, China. Association for Computational Linguistics.
Cite (Informal):: A Computational Study of Matrix Decomposition Methods for Compression of Pre-trained Transformers (Pletenev et al., PACLIC 2023)
Copy Citation:
PDF:: https://aclanthology.org/2023.paclic-1.73.pdf

PDF Cite Search Fix data

Export citation

BibTeX
MODS XML
Endnote
Preformatted

@inproceedings{pletenev-etal-2023-computational,
    title = "A Computational Study of Matrix Decomposition Methods for Compression of Pre-trained Transformers",
    author = "Pletenev, Sergey  and
      Chekalina, Viktoriia  and
      Moskovskiy, Daniil  and
      Seleznev, Mikhail  and
      Zagoruyko, Sergey  and
      Panchenko, Alexander",
    editor = "Huang, Chu-Ren  and
      Harada, Yasunari  and
      Kim, Jong-Bok  and
      Chen, Si  and
      Hsu, Yu-Yin  and
      Chersoni, Emmanuele  and
      A, Pranav  and
      Zeng, Winnie Huiheng  and
      Peng, Bo  and
      Li, Yuxi  and
      Li, Junlin",
    booktitle = "Proceedings of the 37th Pacific Asia Conference on Language, Information and Computation",
    month = dec,
    year = "2023",
    address = "Hong Kong, China",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/2023.paclic-1.73/",
    pages = "723--742"
}

Download as File

<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="pletenev-etal-2023-computational">
    <titleInfo>
        <title>A Computational Study of Matrix Decomposition Methods for Compression of Pre-trained Transformers</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Sergey</namePart>
        <namePart type="family">Pletenev</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Viktoriia</namePart>
        <namePart type="family">Chekalina</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Daniil</namePart>
        <namePart type="family">Moskovskiy</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Mikhail</namePart>
        <namePart type="family">Seleznev</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Sergey</namePart>
        <namePart type="family">Zagoruyko</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Alexander</namePart>
        <namePart type="family">Panchenko</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2023-12</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the 37th Pacific Asia Conference on Language, Information and Computation</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Chu-Ren</namePart>
            <namePart type="family">Huang</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Yasunari</namePart>
            <namePart type="family">Harada</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Jong-Bok</namePart>
            <namePart type="family">Kim</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Si</namePart>
            <namePart type="family">Chen</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Yu-Yin</namePart>
            <namePart type="family">Hsu</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Emmanuele</namePart>
            <namePart type="family">Chersoni</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Pranav</namePart>
            <namePart type="family">A</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Winnie</namePart>
            <namePart type="given">Huiheng</namePart>
            <namePart type="family">Zeng</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Bo</namePart>
            <namePart type="family">Peng</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Yuxi</namePart>
            <namePart type="family">Li</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Junlin</namePart>
            <namePart type="family">Li</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Hong Kong, China</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <identifier type="citekey">pletenev-etal-2023-computational</identifier>
    <location>
        <url>https://aclanthology.org/2023.paclic-1.73/</url>
    </location>
    <part>
        <date>2023-12</date>
        <extent unit="page">
            <start>723</start>
            <end>742</end>
        </extent>
    </part>
</mods>
</modsCollection>

Download as File

%0 Conference Proceedings
%T A Computational Study of Matrix Decomposition Methods for Compression of Pre-trained Transformers
%A Pletenev, Sergey
%A Chekalina, Viktoriia
%A Moskovskiy, Daniil
%A Seleznev, Mikhail
%A Zagoruyko, Sergey
%A Panchenko, Alexander
%Y Huang, Chu-Ren
%Y Harada, Yasunari
%Y Kim, Jong-Bok
%Y Chen, Si
%Y Hsu, Yu-Yin
%Y Chersoni, Emmanuele
%Y A, Pranav
%Y Zeng, Winnie Huiheng
%Y Peng, Bo
%Y Li, Yuxi
%Y Li, Junlin
%S Proceedings of the 37th Pacific Asia Conference on Language, Information and Computation
%D 2023
%8 December
%I Association for Computational Linguistics
%C Hong Kong, China
%F pletenev-etal-2023-computational
%U https://aclanthology.org/2023.paclic-1.73/
%P 723-742

Download as File

Markdown (Informal)

[A Computational Study of Matrix Decomposition Methods for Compression of Pre-trained Transformers](https://aclanthology.org/2023.paclic-1.73/) (Pletenev et al., PACLIC 2023)

A Computational Study of Matrix Decomposition Methods for Compression of Pre-trained Transformers (Pletenev et al., PACLIC 2023)

ACL

Sergey Pletenev, Viktoriia Chekalina, Daniil Moskovskiy, Mikhail Seleznev, Sergey Zagoruyko, and Alexander Panchenko. 2023. A Computational Study of Matrix Decomposition Methods for Compression of Pre-trained Transformers. In Proceedings of the 37th Pacific Asia Conference on Language, Information and Computation, pages 723–742, Hong Kong, China. Association for Computational Linguistics.