%0 Conference Proceedings
%T Proceedings of the Fourth Workshop on Simple and Efficient Natural Language Processing (SustaiNLP)
%E Sadat Moosavi, Nafise
%E Gurevych, Iryna
%E Hou, Yufang
%E Kim, Gyuwan
%E Kim, Young Jin
%E Schuster, Tal
%E Agrawal, Ameeta
%D 2023
%8 July
%I Association for Computational Linguistics
%C Toronto, Canada (Hybrid)
%F sustainlp-2023-simple
%U https://aclanthology.org/2023.sustainlp-1.0/

%0 Conference Proceedings
%T KwikBucks: Correlation Clustering with Cheap-Weak and Expensive-Strong Signals
%A Silwal, Sandeep
%A Ahmadian, Sara
%A Nystrom, Andrew
%A Mccallum, Andrew
%A Ramachandran, Deepak
%A Kazemi, Mehran
%Y Sadat Moosavi, Nafise
%Y Gurevych, Iryna
%Y Hou, Yufang
%Y Kim, Gyuwan
%Y Kim, Young Jin
%Y Schuster, Tal
%Y Agrawal, Ameeta
%S Proceedings of the Fourth Workshop on Simple and Efficient Natural Language Processing (SustaiNLP)
%D 2023
%8 July
%I Association for Computational Linguistics
%C Toronto, Canada (Hybrid)
%F silwal-etal-2023-kwikbucks
%R 10.18653/v1/2023.sustainlp-1.1
%U https://aclanthology.org/2023.sustainlp-1.1/
%U https://doi.org/10.18653/v1/2023.sustainlp-1.1
%P 1-31

%0 Conference Proceedings
%T Semantic-Oriented Unlabeled Priming for Large-Scale Language Models
%A Liu, Yanchen
%A Schick, Timo
%A Schtze, Hinrich
%Y Sadat Moosavi, Nafise
%Y Gurevych, Iryna
%Y Hou, Yufang
%Y Kim, Gyuwan
%Y Kim, Young Jin
%Y Schuster, Tal
%Y Agrawal, Ameeta
%S Proceedings of the Fourth Workshop on Simple and Efficient Natural Language Processing (SustaiNLP)
%D 2023
%8 July
%I Association for Computational Linguistics
%C Toronto, Canada (Hybrid)
%F liu-etal-2023-semantic
%R 10.18653/v1/2023.sustainlp-1.2
%U https://aclanthology.org/2023.sustainlp-1.2/
%U https://doi.org/10.18653/v1/2023.sustainlp-1.2
%P 32-38

%0 Conference Proceedings
%T oBERTa: Improving Sparse Transfer Learning via improved initialization, distillation, and pruning regimes
%A Campos, Daniel
%A Marques, Alexandre
%A Kurtz, Mark
%A Xiang Zhai, Cheng
%Y Sadat Moosavi, Nafise
%Y Gurevych, Iryna
%Y Hou, Yufang
%Y Kim, Gyuwan
%Y Kim, Young Jin
%Y Schuster, Tal
%Y Agrawal, Ameeta
%S Proceedings of the Fourth Workshop on Simple and Efficient Natural Language Processing (SustaiNLP)
%D 2023
%8 July
%I Association for Computational Linguistics
%C Toronto, Canada (Hybrid)
%F campos-etal-2023-oberta
%R 10.18653/v1/2023.sustainlp-1.3
%U https://aclanthology.org/2023.sustainlp-1.3/
%U https://doi.org/10.18653/v1/2023.sustainlp-1.3
%P 39-58

%0 Conference Proceedings
%T Quick Dense Retrievers Consume KALE: Post Training KullbackLeibler Alignment of Embeddings for Asymmetrical dual encoders
%A Campos, Daniel
%A Magnani, Alessandro
%A Zhai, Chengxiang
%Y Sadat Moosavi, Nafise
%Y Gurevych, Iryna
%Y Hou, Yufang
%Y Kim, Gyuwan
%Y Kim, Young Jin
%Y Schuster, Tal
%Y Agrawal, Ameeta
%S Proceedings of the Fourth Workshop on Simple and Efficient Natural Language Processing (SustaiNLP)
%D 2023
%8 July
%I Association for Computational Linguistics
%C Toronto, Canada (Hybrid)
%F campos-etal-2023-quick
%R 10.18653/v1/2023.sustainlp-1.4
%U https://aclanthology.org/2023.sustainlp-1.4/
%U https://doi.org/10.18653/v1/2023.sustainlp-1.4
%P 59-77

%0 Conference Proceedings
%T Lessons on Parameter Sharing across Layers in Transformers
%A Takase, Sho
%A Kiyono, Shun
%Y Sadat Moosavi, Nafise
%Y Gurevych, Iryna
%Y Hou, Yufang
%Y Kim, Gyuwan
%Y Kim, Young Jin
%Y Schuster, Tal
%Y Agrawal, Ameeta
%S Proceedings of the Fourth Workshop on Simple and Efficient Natural Language Processing (SustaiNLP)
%D 2023
%8 July
%I Association for Computational Linguistics
%C Toronto, Canada (Hybrid)
%F takase-kiyono-2023-lessons
%R 10.18653/v1/2023.sustainlp-1.5
%U https://aclanthology.org/2023.sustainlp-1.5/
%U https://doi.org/10.18653/v1/2023.sustainlp-1.5
%P 78-90

%0 Conference Proceedings
%T To Asymmetry and Beyond: Structured Pruning of Sequence to Sequence Models for Improved Inference Efficiency
%A Campos, Daniel
%A Zhai, Chengxiang
%Y Sadat Moosavi, Nafise
%Y Gurevych, Iryna
%Y Hou, Yufang
%Y Kim, Gyuwan
%Y Kim, Young Jin
%Y Schuster, Tal
%Y Agrawal, Ameeta
%S Proceedings of the Fourth Workshop on Simple and Efficient Natural Language Processing (SustaiNLP)
%D 2023
%8 July
%I Association for Computational Linguistics
%C Toronto, Canada (Hybrid)
%F campos-zhai-2023-asymmetry
%R 10.18653/v1/2023.sustainlp-1.6
%U https://aclanthology.org/2023.sustainlp-1.6/
%U https://doi.org/10.18653/v1/2023.sustainlp-1.6
%P 91-109

%0 Conference Proceedings
%T Small is the New Big: Pre-finetuned compact models are better for Asynchronous Active Learning
%A Liu, Dantong
%A Pavani, Kaushik
%A Dasgupta, Sunny
%Y Sadat Moosavi, Nafise
%Y Gurevych, Iryna
%Y Hou, Yufang
%Y Kim, Gyuwan
%Y Kim, Young Jin
%Y Schuster, Tal
%Y Agrawal, Ameeta
%S Proceedings of the Fourth Workshop on Simple and Efficient Natural Language Processing (SustaiNLP)
%D 2023
%8 July
%I Association for Computational Linguistics
%C Toronto, Canada (Hybrid)
%F liu-etal-2023-small
%R 10.18653/v1/2023.sustainlp-1.7
%U https://aclanthology.org/2023.sustainlp-1.7/
%U https://doi.org/10.18653/v1/2023.sustainlp-1.7
%P 110-120

%0 Conference Proceedings
%T ADEPT: Adapter-based Efficient Prompt Tuning Approach for Language Models
%A Shah, Aditya
%A Thapa, Surendrabikram
%A Jain, Aneesh
%A Huang, Lifu
%Y Sadat Moosavi, Nafise
%Y Gurevych, Iryna
%Y Hou, Yufang
%Y Kim, Gyuwan
%Y Kim, Young Jin
%Y Schuster, Tal
%Y Agrawal, Ameeta
%S Proceedings of the Fourth Workshop on Simple and Efficient Natural Language Processing (SustaiNLP)
%D 2023
%8 July
%I Association for Computational Linguistics
%C Toronto, Canada (Hybrid)
%F shah-etal-2023-adept
%R 10.18653/v1/2023.sustainlp-1.8
%U https://aclanthology.org/2023.sustainlp-1.8/
%U https://doi.org/10.18653/v1/2023.sustainlp-1.8
%P 121-128

%0 Conference Proceedings
%T NLU on Data Diets: Dynamic Data Subset Selection for NLP Classification Tasks
%A Attendu, Jean-michel
%A Corbeil, Jean-philippe
%Y Sadat Moosavi, Nafise
%Y Gurevych, Iryna
%Y Hou, Yufang
%Y Kim, Gyuwan
%Y Kim, Young Jin
%Y Schuster, Tal
%Y Agrawal, Ameeta
%S Proceedings of the Fourth Workshop on Simple and Efficient Natural Language Processing (SustaiNLP)
%D 2023
%8 July
%I Association for Computational Linguistics
%C Toronto, Canada (Hybrid)
%F attendu-corbeil-2023-nlu
%R 10.18653/v1/2023.sustainlp-1.9
%U https://aclanthology.org/2023.sustainlp-1.9/
%U https://doi.org/10.18653/v1/2023.sustainlp-1.9
%P 129-146

%0 Conference Proceedings
%T On the Interactions of Structural Constraints and Data Resources for Structured Prediction
%A Zhang, Zhisong
%A Strubell, Emma
%A Hovy, Eduard
%Y Sadat Moosavi, Nafise
%Y Gurevych, Iryna
%Y Hou, Yufang
%Y Kim, Gyuwan
%Y Kim, Young Jin
%Y Schuster, Tal
%Y Agrawal, Ameeta
%S Proceedings of the Fourth Workshop on Simple and Efficient Natural Language Processing (SustaiNLP)
%D 2023
%8 July
%I Association for Computational Linguistics
%C Toronto, Canada (Hybrid)
%F zhang-etal-2023-interactions
%R 10.18653/v1/2023.sustainlp-1.10
%U https://aclanthology.org/2023.sustainlp-1.10/
%U https://doi.org/10.18653/v1/2023.sustainlp-1.10
%P 147-157

%0 Conference Proceedings
%T Can we Pretrain a SotA Legal Language Model on a Budget From Scratch?
%A Niklaus, Joel
%A Giofre, Daniele
%Y Sadat Moosavi, Nafise
%Y Gurevych, Iryna
%Y Hou, Yufang
%Y Kim, Gyuwan
%Y Kim, Young Jin
%Y Schuster, Tal
%Y Agrawal, Ameeta
%S Proceedings of the Fourth Workshop on Simple and Efficient Natural Language Processing (SustaiNLP)
%D 2023
%8 July
%I Association for Computational Linguistics
%C Toronto, Canada (Hybrid)
%F niklaus-giofre-2023-pretrain
%R 10.18653/v1/2023.sustainlp-1.11
%U https://aclanthology.org/2023.sustainlp-1.11/
%U https://doi.org/10.18653/v1/2023.sustainlp-1.11
%P 158-182

%0 Conference Proceedings
%T Is a Video worth n n Images? A Highly Efficient Approach to Transformer-based Video Question Answering
%A Lyu, Chenyang
%A Ji, Tianbo
%A Graham, Yvette
%A Foster, Jennifer
%Y Sadat Moosavi, Nafise
%Y Gurevych, Iryna
%Y Hou, Yufang
%Y Kim, Gyuwan
%Y Kim, Young Jin
%Y Schuster, Tal
%Y Agrawal, Ameeta
%S Proceedings of the Fourth Workshop on Simple and Efficient Natural Language Processing (SustaiNLP)
%D 2023
%8 July
%I Association for Computational Linguistics
%C Toronto, Canada (Hybrid)
%F lyu-etal-2023-video
%R 10.18653/v1/2023.sustainlp-1.12
%U https://aclanthology.org/2023.sustainlp-1.12/
%U https://doi.org/10.18653/v1/2023.sustainlp-1.12
%P 183-189

%0 Conference Proceedings
%T How to Unleash the Power of Large Language Models for Few-shot Relation Extraction?
%A Xu, Xin
%A Zhu, Yuqi
%A Wang, Xiaohan
%A Zhang, Ningyu
%Y Sadat Moosavi, Nafise
%Y Gurevych, Iryna
%Y Hou, Yufang
%Y Kim, Gyuwan
%Y Kim, Young Jin
%Y Schuster, Tal
%Y Agrawal, Ameeta
%S Proceedings of the Fourth Workshop on Simple and Efficient Natural Language Processing (SustaiNLP)
%D 2023
%8 July
%I Association for Computational Linguistics
%C Toronto, Canada (Hybrid)
%F xu-etal-2023-unleash
%R 10.18653/v1/2023.sustainlp-1.13
%U https://aclanthology.org/2023.sustainlp-1.13/
%U https://doi.org/10.18653/v1/2023.sustainlp-1.13
%P 190-200

%0 Conference Proceedings
%T Prompting language models improves performance in imbalanced setting
%A Mohta, Jay
%Y Sadat Moosavi, Nafise
%Y Gurevych, Iryna
%Y Hou, Yufang
%Y Kim, Gyuwan
%Y Kim, Young Jin
%Y Schuster, Tal
%Y Agrawal, Ameeta
%S Proceedings of the Fourth Workshop on Simple and Efficient Natural Language Processing (SustaiNLP)
%D 2023
%8 July
%I Association for Computational Linguistics
%C Toronto, Canada (Hybrid)
%F mohta-2023-prompting
%R 10.18653/v1/2023.sustainlp-1.14
%U https://aclanthology.org/2023.sustainlp-1.14/
%U https://doi.org/10.18653/v1/2023.sustainlp-1.14
%P 201-211

%0 Conference Proceedings
%T KGQA Without Retraining
%A Mckenna, Nick
%A Sen, Priyanka
%Y Sadat Moosavi, Nafise
%Y Gurevych, Iryna
%Y Hou, Yufang
%Y Kim, Gyuwan
%Y Kim, Young Jin
%Y Schuster, Tal
%Y Agrawal, Ameeta
%S Proceedings of the Fourth Workshop on Simple and Efficient Natural Language Processing (SustaiNLP)
%D 2023
%8 July
%I Association for Computational Linguistics
%C Toronto, Canada (Hybrid)
%F mckenna-sen-2023-kgqa
%R 10.18653/v1/2023.sustainlp-1.15
%U https://aclanthology.org/2023.sustainlp-1.15/
%U https://doi.org/10.18653/v1/2023.sustainlp-1.15
%P 212-218

%0 Conference Proceedings
%T MANER: Mask Augmented Named Entity Recognition for Extreme Low-Resource Languages
%A Sonkar, Shashank
%A Wang, Zichao
%A Baraniuk, Richard
%Y Sadat Moosavi, Nafise
%Y Gurevych, Iryna
%Y Hou, Yufang
%Y Kim, Gyuwan
%Y Kim, Young Jin
%Y Schuster, Tal
%Y Agrawal, Ameeta
%S Proceedings of the Fourth Workshop on Simple and Efficient Natural Language Processing (SustaiNLP)
%D 2023
%8 July
%I Association for Computational Linguistics
%C Toronto, Canada (Hybrid)
%F sonkar-etal-2023-maner
%R 10.18653/v1/2023.sustainlp-1.16
%U https://aclanthology.org/2023.sustainlp-1.16/
%U https://doi.org/10.18653/v1/2023.sustainlp-1.16
%P 219-226

%0 Conference Proceedings
%T Efficient and Interpretable Compressive Text Summarisation with Unsupervised Dual-Agent Reinforcement Learning
%A Tang, Peggy
%A Gao, Junbin
%A Zhang, Lei
%A Wang, Zhiyong
%Y Sadat Moosavi, Nafise
%Y Gurevych, Iryna
%Y Hou, Yufang
%Y Kim, Gyuwan
%Y Kim, Young Jin
%Y Schuster, Tal
%Y Agrawal, Ameeta
%S Proceedings of the Fourth Workshop on Simple and Efficient Natural Language Processing (SustaiNLP)
%D 2023
%8 July
%I Association for Computational Linguistics
%C Toronto, Canada (Hybrid)
%F tang-etal-2023-efficient
%R 10.18653/v1/2023.sustainlp-1.17
%U https://aclanthology.org/2023.sustainlp-1.17/
%U https://doi.org/10.18653/v1/2023.sustainlp-1.17
%P 227-238

%0 Conference Proceedings
%T Exploring the Effect of Frequency Resolution in FNet
%A Szumel, Gregory
%A Khalighinejad, Ghazal
%A Stureborg, Rickard
%A Wiseman, Sam
%Y Sadat Moosavi, Nafise
%Y Gurevych, Iryna
%Y Hou, Yufang
%Y Kim, Gyuwan
%Y Kim, Young Jin
%Y Schuster, Tal
%Y Agrawal, Ameeta
%S Proceedings of the Fourth Workshop on Simple and Efficient Natural Language Processing (SustaiNLP)
%D 2023
%8 July
%I Association for Computational Linguistics
%C Toronto, Canada (Hybrid)
%F szumel-etal-2023-exploring
%R 10.18653/v1/2023.sustainlp-1.18
%U https://aclanthology.org/2023.sustainlp-1.18/
%U https://doi.org/10.18653/v1/2023.sustainlp-1.18
%P 239-244

%0 Conference Proceedings
%T Towards Adaptable and Interactive Image Captioning with Data Augmentation and Episodic Memory
%A Anagnostopoulou, Aliki
%A Hartmann, Mareike
%A Sonntag, Daniel
%Y Sadat Moosavi, Nafise
%Y Gurevych, Iryna
%Y Hou, Yufang
%Y Kim, Gyuwan
%Y Kim, Young Jin
%Y Schuster, Tal
%Y Agrawal, Ameeta
%S Proceedings of the Fourth Workshop on Simple and Efficient Natural Language Processing (SustaiNLP)
%D 2023
%8 July
%I Association for Computational Linguistics
%C Toronto, Canada (Hybrid)
%F anagnostopoulou-etal-2023-towards
%R 10.18653/v1/2023.sustainlp-1.19
%U https://aclanthology.org/2023.sustainlp-1.19/
%U https://doi.org/10.18653/v1/2023.sustainlp-1.19
%P 245-256

%0 Conference Proceedings
%T Corpus Complexity Matters in Pretraining Language Models
%A Agrawal, Ameeta
%A Singh, Suresh
%Y Sadat Moosavi, Nafise
%Y Gurevych, Iryna
%Y Hou, Yufang
%Y Kim, Gyuwan
%Y Kim, Young Jin
%Y Schuster, Tal
%Y Agrawal, Ameeta
%S Proceedings of the Fourth Workshop on Simple and Efficient Natural Language Processing (SustaiNLP)
%D 2023
%8 July
%I Association for Computational Linguistics
%C Toronto, Canada (Hybrid)
%F agrawal-singh-2023-corpus
%R 10.18653/v1/2023.sustainlp-1.20
%U https://aclanthology.org/2023.sustainlp-1.20/
%U https://doi.org/10.18653/v1/2023.sustainlp-1.20
%P 257-263

%0 Conference Proceedings
%T PersonaPKT: Building Personalized Dialogue Agents via Parameter-efficient Knowledge Transfer
%A Han, Xu
%A Guo, Bin
%A Jung, Yoon
%A Yao, Benjamin
%A Zhang, Yu
%A Liu, Xiaohu
%A Guo, Chenlei
%Y Sadat Moosavi, Nafise
%Y Gurevych, Iryna
%Y Hou, Yufang
%Y Kim, Gyuwan
%Y Kim, Young Jin
%Y Schuster, Tal
%Y Agrawal, Ameeta
%S Proceedings of the Fourth Workshop on Simple and Efficient Natural Language Processing (SustaiNLP)
%D 2023
%8 July
%I Association for Computational Linguistics
%C Toronto, Canada (Hybrid)
%F han-etal-2023-personapkt
%R 10.18653/v1/2023.sustainlp-1.21
%U https://aclanthology.org/2023.sustainlp-1.21/
%U https://doi.org/10.18653/v1/2023.sustainlp-1.21
%P 264-273

%0 Conference Proceedings
%T Small Character Models Match Large Word Models for Autocomplete Under Memory Constraints
%A Jawahar, Ganesh
%A Mukherjee, Subhabrata
%A Dey, Debadeepta
%A Abdul-mageed, Muhammad
%A Lakshmanan, V.s., Laks
%A Mendes, Caio
%A De Rosa, Gustavo
%A Shah, Shital
%Y Sadat Moosavi, Nafise
%Y Gurevych, Iryna
%Y Hou, Yufang
%Y Kim, Gyuwan
%Y Kim, Young Jin
%Y Schuster, Tal
%Y Agrawal, Ameeta
%S Proceedings of the Fourth Workshop on Simple and Efficient Natural Language Processing (SustaiNLP)
%D 2023
%8 July
%I Association for Computational Linguistics
%C Toronto, Canada (Hybrid)
%F jawahar-etal-2023-small
%R 10.18653/v1/2023.sustainlp-1.22
%U https://aclanthology.org/2023.sustainlp-1.22/
%U https://doi.org/10.18653/v1/2023.sustainlp-1.22
%P 274-289

%0 Conference Proceedings
%T Query Encoder Distillation via Embedding Alignment is a Strong Baseline Method to Boost Dense Retriever Online Efficiency
%A Wang, Yuxuan
%A Hong, Lyu
%Y Sadat Moosavi, Nafise
%Y Gurevych, Iryna
%Y Hou, Yufang
%Y Kim, Gyuwan
%Y Kim, Young Jin
%Y Schuster, Tal
%Y Agrawal, Ameeta
%S Proceedings of the Fourth Workshop on Simple and Efficient Natural Language Processing (SustaiNLP)
%D 2023
%8 July
%I Association for Computational Linguistics
%C Toronto, Canada (Hybrid)
%F wang-hong-2023-query
%R 10.18653/v1/2023.sustainlp-1.23
%U https://aclanthology.org/2023.sustainlp-1.23/
%U https://doi.org/10.18653/v1/2023.sustainlp-1.23
%P 290-298

%0 Conference Proceedings
%T Minimalist Entity Disambiguation for Mid-Resource Languages
%A Kruit, Benno
%Y Sadat Moosavi, Nafise
%Y Gurevych, Iryna
%Y Hou, Yufang
%Y Kim, Gyuwan
%Y Kim, Young Jin
%Y Schuster, Tal
%Y Agrawal, Ameeta
%S Proceedings of the Fourth Workshop on Simple and Efficient Natural Language Processing (SustaiNLP)
%D 2023
%8 July
%I Association for Computational Linguistics
%C Toronto, Canada (Hybrid)
%F kruit-2023-minimalist
%R 10.18653/v1/2023.sustainlp-1.24
%U https://aclanthology.org/2023.sustainlp-1.24/
%U https://doi.org/10.18653/v1/2023.sustainlp-1.24
%P 299-306