Proceedings of the Second Workshop on Simple and Efficient Natural Language Processing
Nafise
Sadat
Moosavi
editor
Iryna
Gurevych
editor
Angela
Fan
editor
Thomas
Wolf
editor
Yufang
Hou
editor
Ana
Marasović
editor
Sujith
Ravi
editor
2021-11
Association for Computational Linguistics
Virtual
text
conference publication
sustainlp-2021-simple
https://aclanthology.org/2021.sustainlp-1.0
Low Resource Quadratic Forms for Knowledge Graph Embeddings
Zachary
Zhou
author
Jeffery
Kline
author
Devin
Conathan
author
Glenn
Fung
author
2021-11
text
Proceedings of the Second Workshop on Simple and Efficient Natural Language Processing
Nafise
Sadat
Moosavi
editor
Iryna
Gurevych
editor
Angela
Fan
editor
Thomas
Wolf
editor
Yufang
Hou
editor
Ana
Marasović
editor
Sujith
Ravi
editor
Association for Computational Linguistics
Virtual
conference publication
zhou-etal-2021-low
10.18653/v1/2021.sustainlp-1.1
https://aclanthology.org/2021.sustainlp-1.1
2021-11
1
10
Evaluating the carbon footprint of NLP methods: a survey and analysis of existing tools
Nesrine
Bannour
author
Sahar
Ghannay
author
Aurélie
Névéol
author
Anne-Laure
Ligozat
author
2021-11
text
Proceedings of the Second Workshop on Simple and Efficient Natural Language Processing
Nafise
Sadat
Moosavi
editor
Iryna
Gurevych
editor
Angela
Fan
editor
Thomas
Wolf
editor
Yufang
Hou
editor
Ana
Marasović
editor
Sujith
Ravi
editor
Association for Computational Linguistics
Virtual
conference publication
bannour-etal-2021-evaluating
10.18653/v1/2021.sustainlp-1.2
https://aclanthology.org/2021.sustainlp-1.2
2021-11
11
21
Limitations of Knowledge Distillation for Zero-shot Transfer Learning
Saleh
Soltan
author
Haidar
Khan
author
Wael
Hamza
author
2021-11
text
Proceedings of the Second Workshop on Simple and Efficient Natural Language Processing
Nafise
Sadat
Moosavi
editor
Iryna
Gurevych
editor
Angela
Fan
editor
Thomas
Wolf
editor
Yufang
Hou
editor
Ana
Marasović
editor
Sujith
Ravi
editor
Association for Computational Linguistics
Virtual
conference publication
soltan-etal-2021-limitations
10.18653/v1/2021.sustainlp-1.3
https://aclanthology.org/2021.sustainlp-1.3
2021-11
22
31
Countering the Influence of Essay Length in Neural Essay Scoring
Sungho
Jeon
author
Michael
Strube
author
2021-11
text
Proceedings of the Second Workshop on Simple and Efficient Natural Language Processing
Nafise
Sadat
Moosavi
editor
Iryna
Gurevych
editor
Angela
Fan
editor
Thomas
Wolf
editor
Yufang
Hou
editor
Ana
Marasović
editor
Sujith
Ravi
editor
Association for Computational Linguistics
Virtual
conference publication
jeon-strube-2021-countering
10.18653/v1/2021.sustainlp-1.4
https://aclanthology.org/2021.sustainlp-1.4
2021-11
32
38
Memory-efficient Transformers via Top-k Attention
Ankit
Gupta
author
Guy
Dar
author
Shaya
Goodman
author
David
Ciprut
author
Jonathan
Berant
author
2021-11
text
Proceedings of the Second Workshop on Simple and Efficient Natural Language Processing
Nafise
Sadat
Moosavi
editor
Iryna
Gurevych
editor
Angela
Fan
editor
Thomas
Wolf
editor
Yufang
Hou
editor
Ana
Marasović
editor
Sujith
Ravi
editor
Association for Computational Linguistics
Virtual
conference publication
gupta-etal-2021-memory
10.18653/v1/2021.sustainlp-1.5
https://aclanthology.org/2021.sustainlp-1.5
2021-11
39
52
BioCopy: A Plug-And-Play Span Copy Mechanism in Seq2Seq Models
Yi
Liu
author
Guoan
Zhang
author
Puning
Yu
author
Jianlin
Su
author
Shengfeng
Pan
author
2021-11
text
Proceedings of the Second Workshop on Simple and Efficient Natural Language Processing
Nafise
Sadat
Moosavi
editor
Iryna
Gurevych
editor
Angela
Fan
editor
Thomas
Wolf
editor
Yufang
Hou
editor
Ana
Marasović
editor
Sujith
Ravi
editor
Association for Computational Linguistics
Virtual
conference publication
liu-etal-2021-biocopy
10.18653/v1/2021.sustainlp-1.6
https://aclanthology.org/2021.sustainlp-1.6
2021-11
53
57
Combining Lexical and Dense Retrieval for Computationally Efficient Multi-hop Question Answering
Georgios
Sidiropoulos
author
Nikos
Voskarides
author
Svitlana
Vakulenko
author
Evangelos
Kanoulas
author
2021-11
text
Proceedings of the Second Workshop on Simple and Efficient Natural Language Processing
Nafise
Sadat
Moosavi
editor
Iryna
Gurevych
editor
Angela
Fan
editor
Thomas
Wolf
editor
Yufang
Hou
editor
Ana
Marasović
editor
Sujith
Ravi
editor
Association for Computational Linguistics
Virtual
conference publication
sidiropoulos-etal-2021-combining
10.18653/v1/2021.sustainlp-1.7
https://aclanthology.org/2021.sustainlp-1.7
2021-11
58
63
Learning to Rank in the Age of Muppets: Effectiveness–Efficiency Tradeoffs in Multi-Stage Ranking
Yue
Zhang
author
ChengCheng
Hu
author
Yuqi
Liu
author
Hui
Fang
author
Jimmy
Lin
author
2021-11
text
Proceedings of the Second Workshop on Simple and Efficient Natural Language Processing
Nafise
Sadat
Moosavi
editor
Iryna
Gurevych
editor
Angela
Fan
editor
Thomas
Wolf
editor
Yufang
Hou
editor
Ana
Marasović
editor
Sujith
Ravi
editor
Association for Computational Linguistics
Virtual
conference publication
zhang-etal-2021-learning-rank
10.18653/v1/2021.sustainlp-1.8
https://aclanthology.org/2021.sustainlp-1.8
2021-11
64
73
Improving Synonym Recommendation Using Sentence Context
Maria
Glenski
author
William
I
Sealy
author
Kate
Miller
author
Dustin
Arendt
author
2021-11
text
Proceedings of the Second Workshop on Simple and Efficient Natural Language Processing
Nafise
Sadat
Moosavi
editor
Iryna
Gurevych
editor
Angela
Fan
editor
Thomas
Wolf
editor
Yufang
Hou
editor
Ana
Marasović
editor
Sujith
Ravi
editor
Association for Computational Linguistics
Virtual
conference publication
glenski-etal-2021-improving
10.18653/v1/2021.sustainlp-1.9
https://aclanthology.org/2021.sustainlp-1.9
2021-11
74
78
Semantic Categorization of Social Knowledge for Commonsense Question Answering
Gengyu
Wang
author
Xiaochen
Hou
author
Diyi
Yang
author
Kathleen
McKeown
author
Jing
Huang
author
2021-11
text
Proceedings of the Second Workshop on Simple and Efficient Natural Language Processing
Nafise
Sadat
Moosavi
editor
Iryna
Gurevych
editor
Angela
Fan
editor
Thomas
Wolf
editor
Yufang
Hou
editor
Ana
Marasović
editor
Sujith
Ravi
editor
Association for Computational Linguistics
Virtual
conference publication
wang-etal-2021-semantic
10.18653/v1/2021.sustainlp-1.10
https://aclanthology.org/2021.sustainlp-1.10
2021-11
79
85
Speeding Up Transformer Training By Using Dataset Subsampling - An Exploratory Analysis
Lovre
Torbarina
author
Velimir
Mihelčić
author
Bruno
Šarlija
author
Lukasz
Roguski
author
Željko
Kraljević
author
2021-11
text
Proceedings of the Second Workshop on Simple and Efficient Natural Language Processing
Nafise
Sadat
Moosavi
editor
Iryna
Gurevych
editor
Angela
Fan
editor
Thomas
Wolf
editor
Yufang
Hou
editor
Ana
Marasović
editor
Sujith
Ravi
editor
Association for Computational Linguistics
Virtual
conference publication
torbarina-etal-2021-speeding
10.18653/v1/2021.sustainlp-1.11
https://aclanthology.org/2021.sustainlp-1.11
2021-11
86
95
Hyperparameter Power Impact in Transformer Language Model Training
Lucas
Høyberg
Puvis de Chavannes
author
Mads
Guldborg
Kjeldgaard
Kongsbak
author
Timmie
Rantzau
author
Leon
Derczynski
author
2021-11
text
Proceedings of the Second Workshop on Simple and Efficient Natural Language Processing
Nafise
Sadat
Moosavi
editor
Iryna
Gurevych
editor
Angela
Fan
editor
Thomas
Wolf
editor
Yufang
Hou
editor
Ana
Marasović
editor
Sujith
Ravi
editor
Association for Computational Linguistics
Virtual
conference publication
puvis-de-chavannes-etal-2021-hyperparameter
10.18653/v1/2021.sustainlp-1.12
https://aclanthology.org/2021.sustainlp-1.12
2021-11
96
118
Distiller: A Systematic Study of Model Distillation Methods in Natural Language Processing
Haoyu
He
author
Xingjian
Shi
author
Jonas
Mueller
author
Sheng
Zha
author
Mu
Li
author
George
Karypis
author
2021-11
text
Proceedings of the Second Workshop on Simple and Efficient Natural Language Processing
Nafise
Sadat
Moosavi
editor
Iryna
Gurevych
editor
Angela
Fan
editor
Thomas
Wolf
editor
Yufang
Hou
editor
Ana
Marasović
editor
Sujith
Ravi
editor
Association for Computational Linguistics
Virtual
conference publication
he-etal-2021-distiller
10.18653/v1/2021.sustainlp-1.13
https://aclanthology.org/2021.sustainlp-1.13
2021-11
119
133
Shrinking Bigfoot: Reducing wav2vec 2.0 footprint
Zilun
Peng
author
Akshay
Budhkar
author
Ilana
Tuil
author
Jason
Levy
author
Parinaz
Sobhani
author
Raphael
Cohen
author
Jumana
Nassour
author
2021-11
text
Proceedings of the Second Workshop on Simple and Efficient Natural Language Processing
Nafise
Sadat
Moosavi
editor
Iryna
Gurevych
editor
Angela
Fan
editor
Thomas
Wolf
editor
Yufang
Hou
editor
Ana
Marasović
editor
Sujith
Ravi
editor
Association for Computational Linguistics
Virtual
conference publication
peng-etal-2021-shrinking
10.18653/v1/2021.sustainlp-1.14
https://aclanthology.org/2021.sustainlp-1.14
2021-11
134
141
On the Role of Corpus Ordering in Language Modeling
Ameeta
Agrawal
author
Suresh
Singh
author
Lauren
Schneider
author
Michael
Samuels
author
2021-11
text
Proceedings of the Second Workshop on Simple and Efficient Natural Language Processing
Nafise
Sadat
Moosavi
editor
Iryna
Gurevych
editor
Angela
Fan
editor
Thomas
Wolf
editor
Yufang
Hou
editor
Ana
Marasović
editor
Sujith
Ravi
editor
Association for Computational Linguistics
Virtual
conference publication
agrawal-etal-2021-role
10.18653/v1/2021.sustainlp-1.15
https://aclanthology.org/2021.sustainlp-1.15
2021-11
142
154
Efficient Domain Adaptation of Language Models via Adaptive Tokenization
Vin
Sachidananda
author
Jason
Kessler
author
Yi-An
Lai
author
2021-11
text
Proceedings of the Second Workshop on Simple and Efficient Natural Language Processing
Nafise
Sadat
Moosavi
editor
Iryna
Gurevych
editor
Angela
Fan
editor
Thomas
Wolf
editor
Yufang
Hou
editor
Ana
Marasović
editor
Sujith
Ravi
editor
Association for Computational Linguistics
Virtual
conference publication
sachidananda-etal-2021-efficient
10.18653/v1/2021.sustainlp-1.16
https://aclanthology.org/2021.sustainlp-1.16
2021-11
155
165
Unsupervised Contextualized Document Representation
Ankur
Gupta
author
Vivek
Gupta
author
2021-11
text
Proceedings of the Second Workshop on Simple and Efficient Natural Language Processing
Nafise
Sadat
Moosavi
editor
Iryna
Gurevych
editor
Angela
Fan
editor
Thomas
Wolf
editor
Yufang
Hou
editor
Ana
Marasović
editor
Sujith
Ravi
editor
Association for Computational Linguistics
Virtual
conference publication
gupta-gupta-2021-unsupervised
10.18653/v1/2021.sustainlp-1.17
https://aclanthology.org/2021.sustainlp-1.17
2021-11
166
173