Proceedings of the Fourth Workshop on Simple and Efficient Natural Language Processing (SustaiNLP)

Proceedings of the Fourth Workshop on Simple and Efficient Natural Language Processing (SustaiNLP) Nafise Sadat Moosavi editor Iryna Gurevych editor Yufang Hou editor Gyuwan Kim editor Young Jin Kim editor Tal Schuster editor Ameeta Agrawal editor 2023-07 Association for Computational Linguistics Toronto, Canada (Hybrid) text conference publication sustainlp-2023-simple https://aclanthology.org/2023.sustainlp-1.0/ KwikBucks: Correlation Clustering with Cheap-Weak and Expensive-Strong Signals Sandeep Silwal author Sara Ahmadian author Andrew Nystrom author Andrew Mccallum author Deepak Ramachandran author Mehran Kazemi author 2023-07 text Proceedings of the Fourth Workshop on Simple and Efficient Natural Language Processing (SustaiNLP) Nafise Sadat Moosavi editor Iryna Gurevych editor Yufang Hou editor Gyuwan Kim editor Young Jin Kim editor Tal Schuster editor Ameeta Agrawal editor Association for Computational Linguistics Toronto, Canada (Hybrid) conference publication silwal-etal-2023-kwikbucks 10.18653/v1/2023.sustainlp-1.1 https://aclanthology.org/2023.sustainlp-1.1/ 2023-07 1 31 Semantic-Oriented Unlabeled Priming for Large-Scale Language Models Yanchen Liu author Timo Schick author Hinrich Schtze author 2023-07 text Proceedings of the Fourth Workshop on Simple and Efficient Natural Language Processing (SustaiNLP) Nafise Sadat Moosavi editor Iryna Gurevych editor Yufang Hou editor Gyuwan Kim editor Young Jin Kim editor Tal Schuster editor Ameeta Agrawal editor Association for Computational Linguistics Toronto, Canada (Hybrid) conference publication liu-etal-2023-semantic 10.18653/v1/2023.sustainlp-1.2 https://aclanthology.org/2023.sustainlp-1.2/ 2023-07 32 38 oBERTa: Improving Sparse Transfer Learning via improved initialization, distillation, and pruning regimes Daniel Campos author Alexandre Marques author Mark Kurtz author Cheng Xiang Zhai author 2023-07 text Proceedings of the Fourth Workshop on Simple and Efficient Natural Language Processing (SustaiNLP) Nafise Sadat Moosavi editor Iryna Gurevych editor Yufang Hou editor Gyuwan Kim editor Young Jin Kim editor Tal Schuster editor Ameeta Agrawal editor Association for Computational Linguistics Toronto, Canada (Hybrid) conference publication campos-etal-2023-oberta 10.18653/v1/2023.sustainlp-1.3 https://aclanthology.org/2023.sustainlp-1.3/ 2023-07 39 58 Quick Dense Retrievers Consume KALE: Post Training KullbackLeibler Alignment of Embeddings for Asymmetrical dual encoders Daniel Campos author Alessandro Magnani author Chengxiang Zhai author 2023-07 text Proceedings of the Fourth Workshop on Simple and Efficient Natural Language Processing (SustaiNLP) Nafise Sadat Moosavi editor Iryna Gurevych editor Yufang Hou editor Gyuwan Kim editor Young Jin Kim editor Tal Schuster editor Ameeta Agrawal editor Association for Computational Linguistics Toronto, Canada (Hybrid) conference publication campos-etal-2023-quick 10.18653/v1/2023.sustainlp-1.4 https://aclanthology.org/2023.sustainlp-1.4/ 2023-07 59 77 Lessons on Parameter Sharing across Layers in Transformers Sho Takase author Shun Kiyono author 2023-07 text Proceedings of the Fourth Workshop on Simple and Efficient Natural Language Processing (SustaiNLP) Nafise Sadat Moosavi editor Iryna Gurevych editor Yufang Hou editor Gyuwan Kim editor Young Jin Kim editor Tal Schuster editor Ameeta Agrawal editor Association for Computational Linguistics Toronto, Canada (Hybrid) conference publication takase-kiyono-2023-lessons 10.18653/v1/2023.sustainlp-1.5 https://aclanthology.org/2023.sustainlp-1.5/ 2023-07 78 90 To Asymmetry and Beyond: Structured Pruning of Sequence to Sequence Models for Improved Inference Efficiency Daniel Campos author Chengxiang Zhai author 2023-07 text Proceedings of the Fourth Workshop on Simple and Efficient Natural Language Processing (SustaiNLP) Nafise Sadat Moosavi editor Iryna Gurevych editor Yufang Hou editor Gyuwan Kim editor Young Jin Kim editor Tal Schuster editor Ameeta Agrawal editor Association for Computational Linguistics Toronto, Canada (Hybrid) conference publication campos-zhai-2023-asymmetry 10.18653/v1/2023.sustainlp-1.6 https://aclanthology.org/2023.sustainlp-1.6/ 2023-07 91 109 Small is the New Big: Pre-finetuned compact models are better for Asynchronous Active Learning Dantong Liu author Kaushik Pavani author Sunny Dasgupta author 2023-07 text Proceedings of the Fourth Workshop on Simple and Efficient Natural Language Processing (SustaiNLP) Nafise Sadat Moosavi editor Iryna Gurevych editor Yufang Hou editor Gyuwan Kim editor Young Jin Kim editor Tal Schuster editor Ameeta Agrawal editor Association for Computational Linguistics Toronto, Canada (Hybrid) conference publication liu-etal-2023-small 10.18653/v1/2023.sustainlp-1.7 https://aclanthology.org/2023.sustainlp-1.7/ 2023-07 110 120 ADEPT: Adapter-based Efficient Prompt Tuning Approach for Language Models Aditya Shah author Surendrabikram Thapa author Aneesh Jain author Lifu Huang author 2023-07 text Proceedings of the Fourth Workshop on Simple and Efficient Natural Language Processing (SustaiNLP) Nafise Sadat Moosavi editor Iryna Gurevych editor Yufang Hou editor Gyuwan Kim editor Young Jin Kim editor Tal Schuster editor Ameeta Agrawal editor Association for Computational Linguistics Toronto, Canada (Hybrid) conference publication shah-etal-2023-adept 10.18653/v1/2023.sustainlp-1.8 https://aclanthology.org/2023.sustainlp-1.8/ 2023-07 121 128 NLU on Data Diets: Dynamic Data Subset Selection for NLP Classification Tasks Jean-michel Attendu author Jean-philippe Corbeil author 2023-07 text Proceedings of the Fourth Workshop on Simple and Efficient Natural Language Processing (SustaiNLP) Nafise Sadat Moosavi editor Iryna Gurevych editor Yufang Hou editor Gyuwan Kim editor Young Jin Kim editor Tal Schuster editor Ameeta Agrawal editor Association for Computational Linguistics Toronto, Canada (Hybrid) conference publication attendu-corbeil-2023-nlu 10.18653/v1/2023.sustainlp-1.9 https://aclanthology.org/2023.sustainlp-1.9/ 2023-07 129 146 On the Interactions of Structural Constraints and Data Resources for Structured Prediction Zhisong Zhang author Emma Strubell author Eduard Hovy author 2023-07 text Proceedings of the Fourth Workshop on Simple and Efficient Natural Language Processing (SustaiNLP) Nafise Sadat Moosavi editor Iryna Gurevych editor Yufang Hou editor Gyuwan Kim editor Young Jin Kim editor Tal Schuster editor Ameeta Agrawal editor Association for Computational Linguistics Toronto, Canada (Hybrid) conference publication zhang-etal-2023-interactions 10.18653/v1/2023.sustainlp-1.10 https://aclanthology.org/2023.sustainlp-1.10/ 2023-07 147 157 Can we Pretrain a SotA Legal Language Model on a Budget From Scratch? Joel Niklaus author Daniele Giofre author 2023-07 text Proceedings of the Fourth Workshop on Simple and Efficient Natural Language Processing (SustaiNLP) Nafise Sadat Moosavi editor Iryna Gurevych editor Yufang Hou editor Gyuwan Kim editor Young Jin Kim editor Tal Schuster editor Ameeta Agrawal editor Association for Computational Linguistics Toronto, Canada (Hybrid) conference publication niklaus-giofre-2023-pretrain 10.18653/v1/2023.sustainlp-1.11 https://aclanthology.org/2023.sustainlp-1.11/ 2023-07 158 182 Is a Video worth n n Images? A Highly Efficient Approach to Transformer-based Video Question Answering Chenyang Lyu author Tianbo Ji author Yvette Graham author Jennifer Foster author 2023-07 text Proceedings of the Fourth Workshop on Simple and Efficient Natural Language Processing (SustaiNLP) Nafise Sadat Moosavi editor Iryna Gurevych editor Yufang Hou editor Gyuwan Kim editor Young Jin Kim editor Tal Schuster editor Ameeta Agrawal editor Association for Computational Linguistics Toronto, Canada (Hybrid) conference publication lyu-etal-2023-video 10.18653/v1/2023.sustainlp-1.12 https://aclanthology.org/2023.sustainlp-1.12/ 2023-07 183 189 How to Unleash the Power of Large Language Models for Few-shot Relation Extraction? Xin Xu author Yuqi Zhu author Xiaohan Wang author Ningyu Zhang author 2023-07 text Proceedings of the Fourth Workshop on Simple and Efficient Natural Language Processing (SustaiNLP) Nafise Sadat Moosavi editor Iryna Gurevych editor Yufang Hou editor Gyuwan Kim editor Young Jin Kim editor Tal Schuster editor Ameeta Agrawal editor Association for Computational Linguistics Toronto, Canada (Hybrid) conference publication xu-etal-2023-unleash 10.18653/v1/2023.sustainlp-1.13 https://aclanthology.org/2023.sustainlp-1.13/ 2023-07 190 200 Prompting language models improves performance in imbalanced setting Jay Mohta author 2023-07 text Proceedings of the Fourth Workshop on Simple and Efficient Natural Language Processing (SustaiNLP) Nafise Sadat Moosavi editor Iryna Gurevych editor Yufang Hou editor Gyuwan Kim editor Young Jin Kim editor Tal Schuster editor Ameeta Agrawal editor Association for Computational Linguistics Toronto, Canada (Hybrid) conference publication mohta-2023-prompting 10.18653/v1/2023.sustainlp-1.14 https://aclanthology.org/2023.sustainlp-1.14/ 2023-07 201 211 KGQA Without Retraining Nick Mckenna author Priyanka Sen author 2023-07 text Proceedings of the Fourth Workshop on Simple and Efficient Natural Language Processing (SustaiNLP) Nafise Sadat Moosavi editor Iryna Gurevych editor Yufang Hou editor Gyuwan Kim editor Young Jin Kim editor Tal Schuster editor Ameeta Agrawal editor Association for Computational Linguistics Toronto, Canada (Hybrid) conference publication mckenna-sen-2023-kgqa 10.18653/v1/2023.sustainlp-1.15 https://aclanthology.org/2023.sustainlp-1.15/ 2023-07 212 218 MANER: Mask Augmented Named Entity Recognition for Extreme Low-Resource Languages Shashank Sonkar author Zichao Wang author Richard Baraniuk author 2023-07 text Proceedings of the Fourth Workshop on Simple and Efficient Natural Language Processing (SustaiNLP) Nafise Sadat Moosavi editor Iryna Gurevych editor Yufang Hou editor Gyuwan Kim editor Young Jin Kim editor Tal Schuster editor Ameeta Agrawal editor Association for Computational Linguistics Toronto, Canada (Hybrid) conference publication sonkar-etal-2023-maner 10.18653/v1/2023.sustainlp-1.16 https://aclanthology.org/2023.sustainlp-1.16/ 2023-07 219 226 Efficient and Interpretable Compressive Text Summarisation with Unsupervised Dual-Agent Reinforcement Learning Peggy Tang author Junbin Gao author Lei Zhang author Zhiyong Wang author 2023-07 text Proceedings of the Fourth Workshop on Simple and Efficient Natural Language Processing (SustaiNLP) Nafise Sadat Moosavi editor Iryna Gurevych editor Yufang Hou editor Gyuwan Kim editor Young Jin Kim editor Tal Schuster editor Ameeta Agrawal editor Association for Computational Linguistics Toronto, Canada (Hybrid) conference publication tang-etal-2023-efficient 10.18653/v1/2023.sustainlp-1.17 https://aclanthology.org/2023.sustainlp-1.17/ 2023-07 227 238 Exploring the Effect of Frequency Resolution in FNet Gregory Szumel author Ghazal Khalighinejad author Rickard Stureborg author Sam Wiseman author 2023-07 text Proceedings of the Fourth Workshop on Simple and Efficient Natural Language Processing (SustaiNLP) Nafise Sadat Moosavi editor Iryna Gurevych editor Yufang Hou editor Gyuwan Kim editor Young Jin Kim editor Tal Schuster editor Ameeta Agrawal editor Association for Computational Linguistics Toronto, Canada (Hybrid) conference publication szumel-etal-2023-exploring 10.18653/v1/2023.sustainlp-1.18 https://aclanthology.org/2023.sustainlp-1.18/ 2023-07 239 244 Towards Adaptable and Interactive Image Captioning with Data Augmentation and Episodic Memory Aliki Anagnostopoulou author Mareike Hartmann author Daniel Sonntag author 2023-07 text Proceedings of the Fourth Workshop on Simple and Efficient Natural Language Processing (SustaiNLP) Nafise Sadat Moosavi editor Iryna Gurevych editor Yufang Hou editor Gyuwan Kim editor Young Jin Kim editor Tal Schuster editor Ameeta Agrawal editor Association for Computational Linguistics Toronto, Canada (Hybrid) conference publication anagnostopoulou-etal-2023-towards 10.18653/v1/2023.sustainlp-1.19 https://aclanthology.org/2023.sustainlp-1.19/ 2023-07 245 256 Corpus Complexity Matters in Pretraining Language Models Ameeta Agrawal author Suresh Singh author 2023-07 text Proceedings of the Fourth Workshop on Simple and Efficient Natural Language Processing (SustaiNLP) Nafise Sadat Moosavi editor Iryna Gurevych editor Yufang Hou editor Gyuwan Kim editor Young Jin Kim editor Tal Schuster editor Ameeta Agrawal editor Association for Computational Linguistics Toronto, Canada (Hybrid) conference publication agrawal-singh-2023-corpus 10.18653/v1/2023.sustainlp-1.20 https://aclanthology.org/2023.sustainlp-1.20/ 2023-07 257 263 PersonaPKT: Building Personalized Dialogue Agents via Parameter-efficient Knowledge Transfer Xu Han author Bin Guo author Yoon Jung author Benjamin Yao author Yu Zhang author Xiaohu Liu author Chenlei Guo author 2023-07 text Proceedings of the Fourth Workshop on Simple and Efficient Natural Language Processing (SustaiNLP) Nafise Sadat Moosavi editor Iryna Gurevych editor Yufang Hou editor Gyuwan Kim editor Young Jin Kim editor Tal Schuster editor Ameeta Agrawal editor Association for Computational Linguistics Toronto, Canada (Hybrid) conference publication han-etal-2023-personapkt 10.18653/v1/2023.sustainlp-1.21 https://aclanthology.org/2023.sustainlp-1.21/ 2023-07 264 273 Small Character Models Match Large Word Models for Autocomplete Under Memory Constraints Ganesh Jawahar author Subhabrata Mukherjee author Debadeepta Dey author Muhammad Abdul-mageed author V.s., Laks Lakshmanan author Caio Mendes author Gustavo De Rosa author Shital Shah author 2023-07 text Proceedings of the Fourth Workshop on Simple and Efficient Natural Language Processing (SustaiNLP) Nafise Sadat Moosavi editor Iryna Gurevych editor Yufang Hou editor Gyuwan Kim editor Young Jin Kim editor Tal Schuster editor Ameeta Agrawal editor Association for Computational Linguistics Toronto, Canada (Hybrid) conference publication jawahar-etal-2023-small 10.18653/v1/2023.sustainlp-1.22 https://aclanthology.org/2023.sustainlp-1.22/ 2023-07 274 289 Query Encoder Distillation via Embedding Alignment is a Strong Baseline Method to Boost Dense Retriever Online Efficiency Yuxuan Wang author Lyu Hong author 2023-07 text Proceedings of the Fourth Workshop on Simple and Efficient Natural Language Processing (SustaiNLP) Nafise Sadat Moosavi editor Iryna Gurevych editor Yufang Hou editor Gyuwan Kim editor Young Jin Kim editor Tal Schuster editor Ameeta Agrawal editor Association for Computational Linguistics Toronto, Canada (Hybrid) conference publication wang-hong-2023-query 10.18653/v1/2023.sustainlp-1.23 https://aclanthology.org/2023.sustainlp-1.23/ 2023-07 290 298 Minimalist Entity Disambiguation for Mid-Resource Languages Benno Kruit author 2023-07 text Proceedings of the Fourth Workshop on Simple and Efficient Natural Language Processing (SustaiNLP) Nafise Sadat Moosavi editor Iryna Gurevych editor Yufang Hou editor Gyuwan Kim editor Young Jin Kim editor Tal Schuster editor Ameeta Agrawal editor Association for Computational Linguistics Toronto, Canada (Hybrid) conference publication kruit-2023-minimalist 10.18653/v1/2023.sustainlp-1.24 https://aclanthology.org/2023.sustainlp-1.24/ 2023-07 299 306