<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="cao-etal-2020-towards">
    <titleInfo>
        <title>Towards Accurate and Reliable Energy Measurement of NLP Models</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Qingqing</namePart>
        <namePart type="family">Cao</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Aruna</namePart>
        <namePart type="family">Balasubramanian</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Niranjan</namePart>
        <namePart type="family">Balasubramanian</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2020-11</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of SustaiNLP: Workshop on Simple and Efficient Natural Language Processing</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Nafise</namePart>
            <namePart type="given">Sadat</namePart>
            <namePart type="family">Moosavi</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Angela</namePart>
            <namePart type="family">Fan</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Vered</namePart>
            <namePart type="family">Shwartz</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Goran</namePart>
            <namePart type="family">Glavaš</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Shafiq</namePart>
            <namePart type="family">Joty</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Alex</namePart>
            <namePart type="family">Wang</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Thomas</namePart>
            <namePart type="family">Wolf</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Online</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>Accurate and reliable measurement of energy consumption is critical for making well-informed design choices when choosing and training large scale NLP models. In this work, we show that existing software-based energy estimations are not accurate because they do not take into account hardware differences and how resource utilization affects energy consumption. We conduct energy measurement experiments with four different models for a question answering task. We quantify the error of existing software-based energy estimations by using a hardware power meter that provides highly accurate energy measurements. Our key takeaway is the need for a more accurate energy estimation model that takes into account hardware variabilities and the non-linear relationship between resource utilization and energy consumption. We release the code and data at https://github.com/csarron/sustainlp2020-energy.</abstract>
    <identifier type="citekey">cao-etal-2020-towards</identifier>
    <identifier type="doi">10.18653/v1/2020.sustainlp-1.19</identifier>
    <location>
        <url>https://aclanthology.org/2020.sustainlp-1.19/</url>
    </location>
    <part>
        <date>2020-11</date>
        <extent unit="page">
            <start>141</start>
            <end>148</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T Towards Accurate and Reliable Energy Measurement of NLP Models
%A Cao, Qingqing
%A Balasubramanian, Aruna
%A Balasubramanian, Niranjan
%Y Moosavi, Nafise Sadat
%Y Fan, Angela
%Y Shwartz, Vered
%Y Glavaš, Goran
%Y Joty, Shafiq
%Y Wang, Alex
%Y Wolf, Thomas
%S Proceedings of SustaiNLP: Workshop on Simple and Efficient Natural Language Processing
%D 2020
%8 November
%I Association for Computational Linguistics
%C Online
%F cao-etal-2020-towards
%X Accurate and reliable measurement of energy consumption is critical for making well-informed design choices when choosing and training large scale NLP models. In this work, we show that existing software-based energy estimations are not accurate because they do not take into account hardware differences and how resource utilization affects energy consumption. We conduct energy measurement experiments with four different models for a question answering task. We quantify the error of existing software-based energy estimations by using a hardware power meter that provides highly accurate energy measurements. Our key takeaway is the need for a more accurate energy estimation model that takes into account hardware variabilities and the non-linear relationship between resource utilization and energy consumption. We release the code and data at https://github.com/csarron/sustainlp2020-energy.
%R 10.18653/v1/2020.sustainlp-1.19
%U https://aclanthology.org/2020.sustainlp-1.19/
%U https://doi.org/10.18653/v1/2020.sustainlp-1.19
%P 141-148

Markdown (Informal)

[Towards Accurate and Reliable Energy Measurement of NLP Models](https://aclanthology.org/2020.sustainlp-1.19/) (Cao et al., sustainlp 2020)

• Towards Accurate and Reliable Energy Measurement of NLP Models (Cao et al., sustainlp 2020)

ACL

• Qingqing Cao, Aruna Balasubramanian, and Niranjan Balasubramanian. 2020. Towards Accurate and Reliable Energy Measurement of NLP Models. In Proceedings of SustaiNLP: Workshop on Simple and Efficient Natural Language Processing, pages 141–148, Online. Association for Computational Linguistics.