%0 Conference Proceedings
%T Proceedings of the Second Workshop on Simple and Efficient Natural Language Processing
%E Moosavi, Nafise Sadat
%E Gurevych, Iryna
%E Fan, Angela
%E Wolf, Thomas
%E Hou, Yufang
%E Marasović, Ana
%E Ravi, Sujith
%D 2021
%8 November
%I Association for Computational Linguistics
%C Virtual
%F sustainlp-2021-simple
%U https://aclanthology.org/2021.sustainlp-1.0/

%0 Conference Proceedings
%T Low Resource Quadratic Forms for Knowledge Graph Embeddings
%A Zhou, Zachary
%A Kline, Jeffery
%A Conathan, Devin
%A Fung, Glenn
%Y Moosavi, Nafise Sadat
%Y Gurevych, Iryna
%Y Fan, Angela
%Y Wolf, Thomas
%Y Hou, Yufang
%Y Marasović, Ana
%Y Ravi, Sujith
%S Proceedings of the Second Workshop on Simple and Efficient Natural Language Processing
%D 2021
%8 November
%I Association for Computational Linguistics
%C Virtual
%F zhou-etal-2021-low
%R 10.18653/v1/2021.sustainlp-1.1
%U https://aclanthology.org/2021.sustainlp-1.1/
%U https://doi.org/10.18653/v1/2021.sustainlp-1.1
%P 1-10

%0 Conference Proceedings
%T Evaluating the carbon footprint of NLP methods: a survey and analysis of existing tools
%A Bannour, Nesrine
%A Ghannay, Sahar
%A Névéol, Aurélie
%A Ligozat, Anne-Laure
%Y Moosavi, Nafise Sadat
%Y Gurevych, Iryna
%Y Fan, Angela
%Y Wolf, Thomas
%Y Hou, Yufang
%Y Marasović, Ana
%Y Ravi, Sujith
%S Proceedings of the Second Workshop on Simple and Efficient Natural Language Processing
%D 2021
%8 November
%I Association for Computational Linguistics
%C Virtual
%F bannour-etal-2021-evaluating
%R 10.18653/v1/2021.sustainlp-1.2
%U https://aclanthology.org/2021.sustainlp-1.2/
%U https://doi.org/10.18653/v1/2021.sustainlp-1.2
%P 11-21

%0 Conference Proceedings
%T Limitations of Knowledge Distillation for Zero-shot Transfer Learning
%A Soltan, Saleh
%A Khan, Haidar
%A Hamza, Wael
%Y Moosavi, Nafise Sadat
%Y Gurevych, Iryna
%Y Fan, Angela
%Y Wolf, Thomas
%Y Hou, Yufang
%Y Marasović, Ana
%Y Ravi, Sujith
%S Proceedings of the Second Workshop on Simple and Efficient Natural Language Processing
%D 2021
%8 November
%I Association for Computational Linguistics
%C Virtual
%F soltan-etal-2021-limitations
%R 10.18653/v1/2021.sustainlp-1.3
%U https://aclanthology.org/2021.sustainlp-1.3/
%U https://doi.org/10.18653/v1/2021.sustainlp-1.3
%P 22-31

%0 Conference Proceedings
%T Countering the Influence of Essay Length in Neural Essay Scoring
%A Jeon, Sungho
%A Strube, Michael
%Y Moosavi, Nafise Sadat
%Y Gurevych, Iryna
%Y Fan, Angela
%Y Wolf, Thomas
%Y Hou, Yufang
%Y Marasović, Ana
%Y Ravi, Sujith
%S Proceedings of the Second Workshop on Simple and Efficient Natural Language Processing
%D 2021
%8 November
%I Association for Computational Linguistics
%C Virtual
%F jeon-strube-2021-countering
%R 10.18653/v1/2021.sustainlp-1.4
%U https://aclanthology.org/2021.sustainlp-1.4/
%U https://doi.org/10.18653/v1/2021.sustainlp-1.4
%P 32-38

%0 Conference Proceedings
%T Memory-efficient Transformers via Top-k Attention
%A Gupta, Ankit
%A Dar, Guy
%A Goodman, Shaya
%A Ciprut, David
%A Berant, Jonathan
%Y Moosavi, Nafise Sadat
%Y Gurevych, Iryna
%Y Fan, Angela
%Y Wolf, Thomas
%Y Hou, Yufang
%Y Marasović, Ana
%Y Ravi, Sujith
%S Proceedings of the Second Workshop on Simple and Efficient Natural Language Processing
%D 2021
%8 November
%I Association for Computational Linguistics
%C Virtual
%F gupta-etal-2021-memory
%R 10.18653/v1/2021.sustainlp-1.5
%U https://aclanthology.org/2021.sustainlp-1.5/
%U https://doi.org/10.18653/v1/2021.sustainlp-1.5
%P 39-52

%0 Conference Proceedings
%T BioCopy: A Plug-And-Play Span Copy Mechanism in Seq2Seq Models
%A Liu, Yi
%A Zhang, Guoan
%A Yu, Puning
%A Su, Jianlin
%A Pan, Shengfeng
%Y Moosavi, Nafise Sadat
%Y Gurevych, Iryna
%Y Fan, Angela
%Y Wolf, Thomas
%Y Hou, Yufang
%Y Marasović, Ana
%Y Ravi, Sujith
%S Proceedings of the Second Workshop on Simple and Efficient Natural Language Processing
%D 2021
%8 November
%I Association for Computational Linguistics
%C Virtual
%F liu-etal-2021-biocopy
%R 10.18653/v1/2021.sustainlp-1.6
%U https://aclanthology.org/2021.sustainlp-1.6/
%U https://doi.org/10.18653/v1/2021.sustainlp-1.6
%P 53-57

%0 Conference Proceedings
%T Combining Lexical and Dense Retrieval for Computationally Efficient Multi-hop Question Answering
%A Sidiropoulos, Georgios
%A Voskarides, Nikos
%A Vakulenko, Svitlana
%A Kanoulas, Evangelos
%Y Moosavi, Nafise Sadat
%Y Gurevych, Iryna
%Y Fan, Angela
%Y Wolf, Thomas
%Y Hou, Yufang
%Y Marasović, Ana
%Y Ravi, Sujith
%S Proceedings of the Second Workshop on Simple and Efficient Natural Language Processing
%D 2021
%8 November
%I Association for Computational Linguistics
%C Virtual
%F sidiropoulos-etal-2021-combining
%R 10.18653/v1/2021.sustainlp-1.7
%U https://aclanthology.org/2021.sustainlp-1.7/
%U https://doi.org/10.18653/v1/2021.sustainlp-1.7
%P 58-63

%0 Conference Proceedings
%T Learning to Rank in the Age of Muppets: Effectiveness–Efficiency Tradeoffs in Multi-Stage Ranking
%A Zhang, Yue
%A Hu, ChengCheng
%A Liu, Yuqi
%A Fang, Hui
%A Lin, Jimmy
%Y Moosavi, Nafise Sadat
%Y Gurevych, Iryna
%Y Fan, Angela
%Y Wolf, Thomas
%Y Hou, Yufang
%Y Marasović, Ana
%Y Ravi, Sujith
%S Proceedings of the Second Workshop on Simple and Efficient Natural Language Processing
%D 2021
%8 November
%I Association for Computational Linguistics
%C Virtual
%F zhang-etal-2021-learning-rank
%R 10.18653/v1/2021.sustainlp-1.8
%U https://aclanthology.org/2021.sustainlp-1.8/
%U https://doi.org/10.18653/v1/2021.sustainlp-1.8
%P 64-73

%0 Conference Proceedings
%T Improving Synonym Recommendation Using Sentence Context
%A Glenski, Maria
%A Sealy, William I.
%A Miller, Kate
%A Arendt, Dustin
%Y Moosavi, Nafise Sadat
%Y Gurevych, Iryna
%Y Fan, Angela
%Y Wolf, Thomas
%Y Hou, Yufang
%Y Marasović, Ana
%Y Ravi, Sujith
%S Proceedings of the Second Workshop on Simple and Efficient Natural Language Processing
%D 2021
%8 November
%I Association for Computational Linguistics
%C Virtual
%F glenski-etal-2021-improving
%R 10.18653/v1/2021.sustainlp-1.9
%U https://aclanthology.org/2021.sustainlp-1.9/
%U https://doi.org/10.18653/v1/2021.sustainlp-1.9
%P 74-78

%0 Conference Proceedings
%T Semantic Categorization of Social Knowledge for Commonsense Question Answering
%A Wang, Gengyu
%A Hou, Xiaochen
%A Yang, Diyi
%A McKeown, Kathleen
%A Huang, Jing
%Y Moosavi, Nafise Sadat
%Y Gurevych, Iryna
%Y Fan, Angela
%Y Wolf, Thomas
%Y Hou, Yufang
%Y Marasović, Ana
%Y Ravi, Sujith
%S Proceedings of the Second Workshop on Simple and Efficient Natural Language Processing
%D 2021
%8 November
%I Association for Computational Linguistics
%C Virtual
%F wang-etal-2021-semantic
%R 10.18653/v1/2021.sustainlp-1.10
%U https://aclanthology.org/2021.sustainlp-1.10/
%U https://doi.org/10.18653/v1/2021.sustainlp-1.10
%P 79-85

%0 Conference Proceedings
%T Speeding Up Transformer Training By Using Dataset Subsampling - An Exploratory Analysis
%A Torbarina, Lovre
%A Mihelčić, Velimir
%A Šarlija, Bruno
%A Roguski, Lukasz
%A Kraljević, Željko
%Y Moosavi, Nafise Sadat
%Y Gurevych, Iryna
%Y Fan, Angela
%Y Wolf, Thomas
%Y Hou, Yufang
%Y Marasović, Ana
%Y Ravi, Sujith
%S Proceedings of the Second Workshop on Simple and Efficient Natural Language Processing
%D 2021
%8 November
%I Association for Computational Linguistics
%C Virtual
%F torbarina-etal-2021-speeding
%R 10.18653/v1/2021.sustainlp-1.11
%U https://aclanthology.org/2021.sustainlp-1.11/
%U https://doi.org/10.18653/v1/2021.sustainlp-1.11
%P 86-95

%0 Conference Proceedings
%T Hyperparameter Power Impact in Transformer Language Model Training
%A Puvis de Chavannes, Lucas Høyberg
%A Kongsbak, Mads Guldborg Kjeldgaard
%A Rantzau, Timmie
%A Derczynski, Leon
%Y Moosavi, Nafise Sadat
%Y Gurevych, Iryna
%Y Fan, Angela
%Y Wolf, Thomas
%Y Hou, Yufang
%Y Marasović, Ana
%Y Ravi, Sujith
%S Proceedings of the Second Workshop on Simple and Efficient Natural Language Processing
%D 2021
%8 November
%I Association for Computational Linguistics
%C Virtual
%F puvis-de-chavannes-etal-2021-hyperparameter
%R 10.18653/v1/2021.sustainlp-1.12
%U https://aclanthology.org/2021.sustainlp-1.12/
%U https://doi.org/10.18653/v1/2021.sustainlp-1.12
%P 96-118

%0 Conference Proceedings
%T Distiller: A Systematic Study of Model Distillation Methods in Natural Language Processing
%A He, Haoyu
%A Shi, Xingjian
%A Mueller, Jonas
%A Zha, Sheng
%A Li, Mu
%A Karypis, George
%Y Moosavi, Nafise Sadat
%Y Gurevych, Iryna
%Y Fan, Angela
%Y Wolf, Thomas
%Y Hou, Yufang
%Y Marasović, Ana
%Y Ravi, Sujith
%S Proceedings of the Second Workshop on Simple and Efficient Natural Language Processing
%D 2021
%8 November
%I Association for Computational Linguistics
%C Virtual
%F he-etal-2021-distiller
%R 10.18653/v1/2021.sustainlp-1.13
%U https://aclanthology.org/2021.sustainlp-1.13/
%U https://doi.org/10.18653/v1/2021.sustainlp-1.13
%P 119-133

%0 Conference Proceedings
%T Shrinking Bigfoot: Reducing wav2vec 2.0 footprint
%A Peng, Zilun
%A Budhkar, Akshay
%A Tuil, Ilana
%A Levy, Jason
%A Sobhani, Parinaz
%A Cohen, Raphael
%A Nassour, Jumana
%Y Moosavi, Nafise Sadat
%Y Gurevych, Iryna
%Y Fan, Angela
%Y Wolf, Thomas
%Y Hou, Yufang
%Y Marasović, Ana
%Y Ravi, Sujith
%S Proceedings of the Second Workshop on Simple and Efficient Natural Language Processing
%D 2021
%8 November
%I Association for Computational Linguistics
%C Virtual
%F peng-etal-2021-shrinking
%R 10.18653/v1/2021.sustainlp-1.14
%U https://aclanthology.org/2021.sustainlp-1.14/
%U https://doi.org/10.18653/v1/2021.sustainlp-1.14
%P 134-141

%0 Conference Proceedings
%T On the Role of Corpus Ordering in Language Modeling
%A Agrawal, Ameeta
%A Singh, Suresh
%A Schneider, Lauren
%A Samuels, Michael
%Y Moosavi, Nafise Sadat
%Y Gurevych, Iryna
%Y Fan, Angela
%Y Wolf, Thomas
%Y Hou, Yufang
%Y Marasović, Ana
%Y Ravi, Sujith
%S Proceedings of the Second Workshop on Simple and Efficient Natural Language Processing
%D 2021
%8 November
%I Association for Computational Linguistics
%C Virtual
%F agrawal-etal-2021-role
%R 10.18653/v1/2021.sustainlp-1.15
%U https://aclanthology.org/2021.sustainlp-1.15/
%U https://doi.org/10.18653/v1/2021.sustainlp-1.15
%P 142-154

%0 Conference Proceedings
%T Efficient Domain Adaptation of Language Models via Adaptive Tokenization
%A Sachidananda, Vin
%A Kessler, Jason
%A Lai, Yi-An
%Y Moosavi, Nafise Sadat
%Y Gurevych, Iryna
%Y Fan, Angela
%Y Wolf, Thomas
%Y Hou, Yufang
%Y Marasović, Ana
%Y Ravi, Sujith
%S Proceedings of the Second Workshop on Simple and Efficient Natural Language Processing
%D 2021
%8 November
%I Association for Computational Linguistics
%C Virtual
%F sachidananda-etal-2021-efficient
%R 10.18653/v1/2021.sustainlp-1.16
%U https://aclanthology.org/2021.sustainlp-1.16/
%U https://doi.org/10.18653/v1/2021.sustainlp-1.16
%P 155-165

%0 Conference Proceedings
%T Unsupervised Contextualized Document Representation
%A Gupta, Ankur
%A Gupta, Vivek
%Y Moosavi, Nafise Sadat
%Y Gurevych, Iryna
%Y Fan, Angela
%Y Wolf, Thomas
%Y Hou, Yufang
%Y Marasović, Ana
%Y Ravi, Sujith
%S Proceedings of the Second Workshop on Simple and Efficient Natural Language Processing
%D 2021
%8 November
%I Association for Computational Linguistics
%C Virtual
%F gupta-gupta-2021-unsupervised
%R 10.18653/v1/2021.sustainlp-1.17
%U https://aclanthology.org/2021.sustainlp-1.17/
%U https://doi.org/10.18653/v1/2021.sustainlp-1.17
%P 166-173