Proceedings of NLP Power! The First Workshop on Efficient Benchmarking in NLP

Proceedings of NLP Power! The First Workshop on Efficient Benchmarking in NLP Tatiana Shavrina editor Vladislav Mikhailov editor Valentin Malykh editor Ekaterina Artemova editor Oleg Serikov editor Vitaly Protasov editor 2022-05 Association for Computational Linguistics Dublin, Ireland text conference publication nlppower-2022-nlp https://aclanthology.org/2022.nlppower-1.0/ Raison d’être of the benchmark dataset: A Survey of Current Practices of Benchmark Dataset Sharing Platforms Jaihyun Park author Sullam Jeoung author 2022-05 text Proceedings of NLP Power! The First Workshop on Efficient Benchmarking in NLP Tatiana Shavrina editor Vladislav Mikhailov editor Valentin Malykh editor Ekaterina Artemova editor Oleg Serikov editor Vitaly Protasov editor Association for Computational Linguistics Dublin, Ireland conference publication park-jeoung-2022-raison 10.18653/v1/2022.nlppower-1.1 https://aclanthology.org/2022.nlppower-1.1/ 2022-05 1 10 Towards Stronger Adversarial Baselines Through Human-AI Collaboration Wencong You author Daniel Lowd author 2022-05 text Proceedings of NLP Power! The First Workshop on Efficient Benchmarking in NLP Tatiana Shavrina editor Vladislav Mikhailov editor Valentin Malykh editor Ekaterina Artemova editor Oleg Serikov editor Vitaly Protasov editor Association for Computational Linguistics Dublin, Ireland conference publication you-lowd-2022-towards 10.18653/v1/2022.nlppower-1.2 https://aclanthology.org/2022.nlppower-1.2/ 2022-05 11 21 Benchmarking for Public Health Surveillance tasks on Social Media with a Domain-Specific Pretrained Language Model Usman Naseem author Byoung Chan Lee author Matloob Khushi author Jinman Kim author Adam Dunn author 2022-05 text Proceedings of NLP Power! The First Workshop on Efficient Benchmarking in NLP Tatiana Shavrina editor Vladislav Mikhailov editor Valentin Malykh editor Ekaterina Artemova editor Oleg Serikov editor Vitaly Protasov editor Association for Computational Linguistics Dublin, Ireland conference publication naseem-etal-2022-benchmarking 10.18653/v1/2022.nlppower-1.3 https://aclanthology.org/2022.nlppower-1.3/ 2022-05 22 31 Why only Micro-F1? Class Weighting of Measures for Relation Classification David Harbecke author Yuxuan Chen author Leonhard Hennig author Christoph Alt author 2022-05 text Proceedings of NLP Power! The First Workshop on Efficient Benchmarking in NLP Tatiana Shavrina editor Vladislav Mikhailov editor Valentin Malykh editor Ekaterina Artemova editor Oleg Serikov editor Vitaly Protasov editor Association for Computational Linguistics Dublin, Ireland conference publication harbecke-etal-2022-micro 10.18653/v1/2022.nlppower-1.4 https://aclanthology.org/2022.nlppower-1.4/ 2022-05 32 41 Automatically Discarding Straplines to Improve Data Quality for Abstractive News Summarization Amr Keleg author Matthias Lindemann author Danyang Liu author Wanqiu Long author Bonnie L Webber author 2022-05 text Proceedings of NLP Power! The First Workshop on Efficient Benchmarking in NLP Tatiana Shavrina editor Vladislav Mikhailov editor Valentin Malykh editor Ekaterina Artemova editor Oleg Serikov editor Vitaly Protasov editor Association for Computational Linguistics Dublin, Ireland conference publication keleg-etal-2022-automatically 10.18653/v1/2022.nlppower-1.5 https://aclanthology.org/2022.nlppower-1.5/ 2022-05 42 51 A global analysis of metrics used for measuring performance in natural language processing Kathrin Blagec author Georg Dorffner author Milad Moradi author Simon Ott author Matthias Samwald author 2022-05 text Proceedings of NLP Power! The First Workshop on Efficient Benchmarking in NLP Tatiana Shavrina editor Vladislav Mikhailov editor Valentin Malykh editor Ekaterina Artemova editor Oleg Serikov editor Vitaly Protasov editor Association for Computational Linguistics Dublin, Ireland conference publication blagec-etal-2022-global 10.18653/v1/2022.nlppower-1.6 https://aclanthology.org/2022.nlppower-1.6/ 2022-05 52 63 Beyond Static models and test sets: Benchmarking the potential of pre-trained models across tasks and languages Kabir Ahuja author Sandipan Dandapat author Sunayana Sitaram author Monojit Choudhury author 2022-05 text Proceedings of NLP Power! The First Workshop on Efficient Benchmarking in NLP Tatiana Shavrina editor Vladislav Mikhailov editor Valentin Malykh editor Ekaterina Artemova editor Oleg Serikov editor Vitaly Protasov editor Association for Computational Linguistics Dublin, Ireland conference publication ahuja-etal-2022-beyond 10.18653/v1/2022.nlppower-1.7 https://aclanthology.org/2022.nlppower-1.7/ 2022-05 64 74 Checking HateCheck: a cross-functional analysis of behaviour-aware learning for hate speech detection Pedro Henrique Luz de Araujo author Benjamin Roth author 2022-05 text Proceedings of NLP Power! The First Workshop on Efficient Benchmarking in NLP Tatiana Shavrina editor Vladislav Mikhailov editor Valentin Malykh editor Ekaterina Artemova editor Oleg Serikov editor Vitaly Protasov editor Association for Computational Linguistics Dublin, Ireland conference publication henrique-luz-de-araujo-roth-2022-checking 10.18653/v1/2022.nlppower-1.8 https://aclanthology.org/2022.nlppower-1.8/ 2022-05 75 83 Language Invariant Properties in Natural Language Processing Federico Bianchi author Debora Nozza author Dirk Hovy author 2022-05 text Proceedings of NLP Power! The First Workshop on Efficient Benchmarking in NLP Tatiana Shavrina editor Vladislav Mikhailov editor Valentin Malykh editor Ekaterina Artemova editor Oleg Serikov editor Vitaly Protasov editor Association for Computational Linguistics Dublin, Ireland conference publication bianchi-etal-2022-language 10.18653/v1/2022.nlppower-1.9 https://aclanthology.org/2022.nlppower-1.9/ 2022-05 84 92 DACT-BERT: Differentiable Adaptive Computation Time for an Efficient BERT Inference Cristobal Eyzaguirre author Felipe del Rio author Vladimir Araujo author Alvaro Soto author 2022-05 text Proceedings of NLP Power! The First Workshop on Efficient Benchmarking in NLP Tatiana Shavrina editor Vladislav Mikhailov editor Valentin Malykh editor Ekaterina Artemova editor Oleg Serikov editor Vitaly Protasov editor Association for Computational Linguistics Dublin, Ireland conference publication eyzaguirre-etal-2022-dact 10.18653/v1/2022.nlppower-1.10 https://aclanthology.org/2022.nlppower-1.10/ 2022-05 93 99 Benchmarking Post-Hoc Interpretability Approaches for Transformer-based Misogyny Detection Giuseppe Attanasio author Debora Nozza author Eliana Pastor author Dirk Hovy author 2022-05 text Proceedings of NLP Power! The First Workshop on Efficient Benchmarking in NLP Tatiana Shavrina editor Vladislav Mikhailov editor Valentin Malykh editor Ekaterina Artemova editor Oleg Serikov editor Vitaly Protasov editor Association for Computational Linguistics Dublin, Ireland conference publication attanasio-etal-2022-benchmarking 10.18653/v1/2022.nlppower-1.11 https://aclanthology.org/2022.nlppower-1.11/ 2022-05 100 112 Characterizing the Efficiency vs. Accuracy Trade-off for Long-Context NLP Models Phyllis Ang author Bhuwan Dhingra author Lisa Wu Wills author 2022-05 text Proceedings of NLP Power! The First Workshop on Efficient Benchmarking in NLP Tatiana Shavrina editor Vladislav Mikhailov editor Valentin Malykh editor Ekaterina Artemova editor Oleg Serikov editor Vitaly Protasov editor Association for Computational Linguistics Dublin, Ireland conference publication ang-etal-2022-characterizing 10.18653/v1/2022.nlppower-1.12 https://aclanthology.org/2022.nlppower-1.12/ 2022-05 113 121