Proceedings of the Fifth BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP

Proceedings of the Fifth BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP Jasmijn Bastings editor Yonatan Belinkov editor Yanai Elazar editor Dieuwke Hupkes editor Naomi Saphra editor Sarah Wiegreffe editor 2022-12 Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) text conference publication blackboxnlp-2022-blackboxnlp 10.18653/v1/2022.blackboxnlp-1.0 https://aclanthology.org/2022.blackboxnlp-1.0/ A Minimal Model for Compositional Generalization on gSCAN Alice Hein author Klaus Diepold author 2022-12 text Proceedings of the Fifth BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP Jasmijn Bastings editor Yonatan Belinkov editor Yanai Elazar editor Dieuwke Hupkes editor Naomi Saphra editor Sarah Wiegreffe editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication hein-diepold-2022-minimal 10.18653/v1/2022.blackboxnlp-1.1 https://aclanthology.org/2022.blackboxnlp-1.1/ 2022-12 1 15 Sparse Interventions in Language Models with Differentiable Masking Nicola De Cao author Leon Schmid author Dieuwke Hupkes author Ivan Titov author 2022-12 text Proceedings of the Fifth BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP Jasmijn Bastings editor Yonatan Belinkov editor Yanai Elazar editor Dieuwke Hupkes editor Naomi Saphra editor Sarah Wiegreffe editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication de-cao-etal-2022-sparse 10.18653/v1/2022.blackboxnlp-1.2 https://aclanthology.org/2022.blackboxnlp-1.2/ 2022-12 16 27 Where’s the Learning in Representation Learning for Compositional Semantics and the Case of Thematic Fit Mughilan Muthupari author Samrat Halder author Asad Sayeed author Yuval Marton author 2022-12 text Proceedings of the Fifth BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP Jasmijn Bastings editor Yonatan Belinkov editor Yanai Elazar editor Dieuwke Hupkes editor Naomi Saphra editor Sarah Wiegreffe editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication muthupari-etal-2022-wheres 10.18653/v1/2022.blackboxnlp-1.3 https://aclanthology.org/2022.blackboxnlp-1.3/ 2022-12 28 39 Sentence Ambiguity, Grammaticality and Complexity Probes Sunit Bhattacharya author Vilém Zouhar author Ondrej Bojar author 2022-12 text Proceedings of the Fifth BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP Jasmijn Bastings editor Yonatan Belinkov editor Yanai Elazar editor Dieuwke Hupkes editor Naomi Saphra editor Sarah Wiegreffe editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication bhattacharya-etal-2022-sentence 10.18653/v1/2022.blackboxnlp-1.4 https://aclanthology.org/2022.blackboxnlp-1.4/ 2022-12 40 50 Post-Hoc Interpretation of Transformer Hyperparameters with Explainable Boosting Machines Kiron Deb author Xuan Zhang author Kevin Duh author 2022-12 text Proceedings of the Fifth BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP Jasmijn Bastings editor Yonatan Belinkov editor Yanai Elazar editor Dieuwke Hupkes editor Naomi Saphra editor Sarah Wiegreffe editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication deb-etal-2022-post 10.18653/v1/2022.blackboxnlp-1.5 https://aclanthology.org/2022.blackboxnlp-1.5/ 2022-12 51 61 Revisit Systematic Generalization via Meaningful Learning Ning Shi author Boxin Wang author Wei Wang author Xiangyu Liu author Zhouhan Lin author 2022-12 text Proceedings of the Fifth BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP Jasmijn Bastings editor Yonatan Belinkov editor Yanai Elazar editor Dieuwke Hupkes editor Naomi Saphra editor Sarah Wiegreffe editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication shi-etal-2022-revisit 10.18653/v1/2022.blackboxnlp-1.6 https://aclanthology.org/2022.blackboxnlp-1.6/ 2022-12 62 79 Is It Smaller Than a Tennis Ball? Language Models Play the Game of Twenty Questions Maxime De Bruyn author Ehsan Lotfi author Jeska Buhmann author Walter Daelemans author 2022-12 text Proceedings of the Fifth BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP Jasmijn Bastings editor Yonatan Belinkov editor Yanai Elazar editor Dieuwke Hupkes editor Naomi Saphra editor Sarah Wiegreffe editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication de-bruyn-etal-2022-smaller 10.18653/v1/2022.blackboxnlp-1.7 https://aclanthology.org/2022.blackboxnlp-1.7/ 2022-12 80 90 Post-hoc analysis of Arabic transformer models Ahmed Abdelali author Nadir Durrani author Fahim Dalvi author Hassan Sajjad author 2022-12 text Proceedings of the Fifth BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP Jasmijn Bastings editor Yonatan Belinkov editor Yanai Elazar editor Dieuwke Hupkes editor Naomi Saphra editor Sarah Wiegreffe editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication abdelali-etal-2022-post 10.18653/v1/2022.blackboxnlp-1.8 https://aclanthology.org/2022.blackboxnlp-1.8/ 2022-12 91 103 Universal Evasion Attacks on Summarization Scoring Wenchuan Mu author Kwan Hui Lim author 2022-12 text Proceedings of the Fifth BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP Jasmijn Bastings editor Yonatan Belinkov editor Yanai Elazar editor Dieuwke Hupkes editor Naomi Saphra editor Sarah Wiegreffe editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication mu-lim-2022-universal 10.18653/v1/2022.blackboxnlp-1.9 https://aclanthology.org/2022.blackboxnlp-1.9/ 2022-12 104 118 How (Un)Faithful is Attention? Hessam Amini author Leila Kosseim author 2022-12 text Proceedings of the Fifth BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP Jasmijn Bastings editor Yonatan Belinkov editor Yanai Elazar editor Dieuwke Hupkes editor Naomi Saphra editor Sarah Wiegreffe editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication amini-kosseim-2022-un 10.18653/v1/2022.blackboxnlp-1.10 https://aclanthology.org/2022.blackboxnlp-1.10/ 2022-12 119 130 Are Multilingual Sentiment Models Equally Right for the Right Reasons? Rasmus Jørgensen author Fiammetta Caccavale author Christian Igel author Anders Søgaard author 2022-12 text Proceedings of the Fifth BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP Jasmijn Bastings editor Yonatan Belinkov editor Yanai Elazar editor Dieuwke Hupkes editor Naomi Saphra editor Sarah Wiegreffe editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication jorgensen-etal-2022-multilingual 10.18653/v1/2022.blackboxnlp-1.11 https://aclanthology.org/2022.blackboxnlp-1.11/ 2022-12 131 141 Probing for Understanding of English Verb Classes and Alternations in Large Pre-trained Language Models David Yi author James Bruno author Jiayu Han author Peter Zukerman author Shane Steinert-Threlkeld author 2022-12 text Proceedings of the Fifth BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP Jasmijn Bastings editor Yonatan Belinkov editor Yanai Elazar editor Dieuwke Hupkes editor Naomi Saphra editor Sarah Wiegreffe editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication yi-etal-2022-probing 10.18653/v1/2022.blackboxnlp-1.12 https://aclanthology.org/2022.blackboxnlp-1.12/ 2022-12 142 152 Analyzing Gender Translation Errors to Identify Information Flows between the Encoder and Decoder of a NMT System Guillaume Wisniewski author Lichao Zhu author Nicolas Ballier author François Yvon author 2022-12 text Proceedings of the Fifth BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP Jasmijn Bastings editor Yonatan Belinkov editor Yanai Elazar editor Dieuwke Hupkes editor Naomi Saphra editor Sarah Wiegreffe editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication wisniewski-etal-2022-analyzing 10.18653/v1/2022.blackboxnlp-1.13 https://aclanthology.org/2022.blackboxnlp-1.13/ 2022-12 153 163 Human Ratings Do Not Reflect Downstream Utility: A Study of Free-Text Explanations for Model Predictions Jenny Kunz author Martin Jirenius author Oskar Holmström author Marco Kuhlmann author 2022-12 text Proceedings of the Fifth BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP Jasmijn Bastings editor Yonatan Belinkov editor Yanai Elazar editor Dieuwke Hupkes editor Naomi Saphra editor Sarah Wiegreffe editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication kunz-etal-2022-human 10.18653/v1/2022.blackboxnlp-1.14 https://aclanthology.org/2022.blackboxnlp-1.14/ 2022-12 164 177 Analyzing the Representational Geometry of Acoustic Word Embeddings Badr Abdullah author Dietrich Klakow author 2022-12 text Proceedings of the Fifth BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP Jasmijn Bastings editor Yonatan Belinkov editor Yanai Elazar editor Dieuwke Hupkes editor Naomi Saphra editor Sarah Wiegreffe editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication abdullah-klakow-2022-analyzing 10.18653/v1/2022.blackboxnlp-1.15 https://aclanthology.org/2022.blackboxnlp-1.15/ 2022-12 178 191 Understanding Domain Learning in Language Models Through Subpopulation Analysis Zheng Zhao author Yftah Ziser author Shay Cohen author 2022-12 text Proceedings of the Fifth BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP Jasmijn Bastings editor Yonatan Belinkov editor Yanai Elazar editor Dieuwke Hupkes editor Naomi Saphra editor Sarah Wiegreffe editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication zhao-etal-2022-understanding 10.18653/v1/2022.blackboxnlp-1.16 https://aclanthology.org/2022.blackboxnlp-1.16/ 2022-12 192 209 Intermediate Entity-based Sparse Interpretable Representation Learning Diego Garcia-Olano author Yasumasa Onoe author Joydeep Ghosh author Byron Wallace author 2022-12 text Proceedings of the Fifth BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP Jasmijn Bastings editor Yonatan Belinkov editor Yanai Elazar editor Dieuwke Hupkes editor Naomi Saphra editor Sarah Wiegreffe editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication garcia-olano-etal-2022-intermediate 10.18653/v1/2022.blackboxnlp-1.17 https://aclanthology.org/2022.blackboxnlp-1.17/ 2022-12 210 224 Towards Procedural Fairness: Uncovering Biases in How a Toxic Language Classifier Uses Sentiment Information Isar Nejadgholi author Esma Balkir author Kathleen Fraser author Svetlana Kiritchenko author 2022-12 text Proceedings of the Fifth BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP Jasmijn Bastings editor Yonatan Belinkov editor Yanai Elazar editor Dieuwke Hupkes editor Naomi Saphra editor Sarah Wiegreffe editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication nejadgholi-etal-2022-towards 10.18653/v1/2022.blackboxnlp-1.18 https://aclanthology.org/2022.blackboxnlp-1.18/ 2022-12 225 237 Investigating the Characteristics of a Transformer in a Few-Shot Setup: Does Freezing Layers in RoBERTa Help? Digvijay Ingle author Rishabh Tripathi author Ayush Kumar author Kevin Patel author Jithendra Vepa author 2022-12 text Proceedings of the Fifth BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP Jasmijn Bastings editor Yonatan Belinkov editor Yanai Elazar editor Dieuwke Hupkes editor Naomi Saphra editor Sarah Wiegreffe editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication ingle-etal-2022-investigating 10.18653/v1/2022.blackboxnlp-1.19 https://aclanthology.org/2022.blackboxnlp-1.19/ 2022-12 238 248 It Is Not Easy To Detect Paraphrases: Analysing Semantic Similarity With Antonyms and Negation Using the New SemAntoNeg Benchmark Teemu Vahtola author Mathias Creutz author Jörg Tiedemann author 2022-12 text Proceedings of the Fifth BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP Jasmijn Bastings editor Yonatan Belinkov editor Yanai Elazar editor Dieuwke Hupkes editor Naomi Saphra editor Sarah Wiegreffe editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication vahtola-etal-2022-easy 10.18653/v1/2022.blackboxnlp-1.20 https://aclanthology.org/2022.blackboxnlp-1.20/ 2022-12 249 262 Controlling for Stereotypes in Multimodal Language Model Evaluation Manuj Malik author Richard Johansson author 2022-12 text Proceedings of the Fifth BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP Jasmijn Bastings editor Yonatan Belinkov editor Yanai Elazar editor Dieuwke Hupkes editor Naomi Saphra editor Sarah Wiegreffe editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication malik-johansson-2022-controlling 10.18653/v1/2022.blackboxnlp-1.21 https://aclanthology.org/2022.blackboxnlp-1.21/ 2022-12 263 271 On the Compositional Generalization Gap of In-Context Learning Arian Hosseini author Ankit Vani author Dzmitry Bahdanau author Alessandro Sordoni author Aaron Courville author 2022-12 text Proceedings of the Fifth BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP Jasmijn Bastings editor Yonatan Belinkov editor Yanai Elazar editor Dieuwke Hupkes editor Naomi Saphra editor Sarah Wiegreffe editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication hosseini-etal-2022-compositional 10.18653/v1/2022.blackboxnlp-1.22 https://aclanthology.org/2022.blackboxnlp-1.22/ 2022-12 272 280 Explaining Translationese: why are Neural Classifiers Better and what do they Learn? Kwabena Amponsah-Kaakyire author Daria Pylypenko author Josef Genabith author Cristina España-Bonet author 2022-12 text Proceedings of the Fifth BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP Jasmijn Bastings editor Yonatan Belinkov editor Yanai Elazar editor Dieuwke Hupkes editor Naomi Saphra editor Sarah Wiegreffe editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication amponsah-kaakyire-etal-2022-explaining 10.18653/v1/2022.blackboxnlp-1.23 https://aclanthology.org/2022.blackboxnlp-1.23/ 2022-12 281 296 Probing GPT-3’s Linguistic Knowledge on Semantic Tasks Lining Zhang author Mengchen Wang author Liben Chen author Wenxin Zhang author 2022-12 text Proceedings of the Fifth BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP Jasmijn Bastings editor Yonatan Belinkov editor Yanai Elazar editor Dieuwke Hupkes editor Naomi Saphra editor Sarah Wiegreffe editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication zhang-etal-2022-probing 10.18653/v1/2022.blackboxnlp-1.24 https://aclanthology.org/2022.blackboxnlp-1.24/ 2022-12 297 304 Garden Path Traversal in GPT-2 William Jurayj author William Rudman author Carsten Eickhoff author 2022-12 text Proceedings of the Fifth BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP Jasmijn Bastings editor Yonatan Belinkov editor Yanai Elazar editor Dieuwke Hupkes editor Naomi Saphra editor Sarah Wiegreffe editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication jurayj-etal-2022-garden 10.18653/v1/2022.blackboxnlp-1.25 https://aclanthology.org/2022.blackboxnlp-1.25/ 2022-12 305 313 Testing Pre-trained Language Models’ Understanding of Distributivity via Causal Mediation Analysis Pangbo Ban author Yifan Jiang author Tianran Liu author Shane Steinert-Threlkeld author 2022-12 text Proceedings of the Fifth BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP Jasmijn Bastings editor Yonatan Belinkov editor Yanai Elazar editor Dieuwke Hupkes editor Naomi Saphra editor Sarah Wiegreffe editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication ban-etal-2022-testing 10.18653/v1/2022.blackboxnlp-1.26 https://aclanthology.org/2022.blackboxnlp-1.26/ 2022-12 314 324 Using Roark-Hollingshead Distance to Probe BERT’s Syntactic Competence Jingcheng Niu author Wenjie Lu author Eric Corlett author Gerald Penn author 2022-12 text Proceedings of the Fifth BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP Jasmijn Bastings editor Yonatan Belinkov editor Yanai Elazar editor Dieuwke Hupkes editor Naomi Saphra editor Sarah Wiegreffe editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication niu-etal-2022-using 10.18653/v1/2022.blackboxnlp-1.27 https://aclanthology.org/2022.blackboxnlp-1.27/ 2022-12 325 334 DALLE-2 is Seeing Double: Flaws in Word-to-Concept Mapping in Text2Image Models Royi Rassin author Shauli Ravfogel author Yoav Goldberg author 2022-12 text Proceedings of the Fifth BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP Jasmijn Bastings editor Yonatan Belinkov editor Yanai Elazar editor Dieuwke Hupkes editor Naomi Saphra editor Sarah Wiegreffe editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication rassin-etal-2022-dalle 10.18653/v1/2022.blackboxnlp-1.28 https://aclanthology.org/2022.blackboxnlp-1.28/ 2022-12 335 345 Practical Benefits of Feature Feedback Under Distribution Shift Anurag Katakkar author Clay H Yoo author Weiqin Wang author Zachary Lipton author Divyansh Kaushik author 2022-12 text Proceedings of the Fifth BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP Jasmijn Bastings editor Yonatan Belinkov editor Yanai Elazar editor Dieuwke Hupkes editor Naomi Saphra editor Sarah Wiegreffe editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication katakkar-etal-2022-practical 10.18653/v1/2022.blackboxnlp-1.29 https://aclanthology.org/2022.blackboxnlp-1.29/ 2022-12 346 355 Identifying the Source of Vulnerability in Explanation Discrepancy: A Case Study in Neural Text Classification Ruixuan Tang author Hanjie Chen author Yangfeng Ji author 2022-12 text Proceedings of the Fifth BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP Jasmijn Bastings editor Yonatan Belinkov editor Yanai Elazar editor Dieuwke Hupkes editor Naomi Saphra editor Sarah Wiegreffe editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication tang-etal-2022-identifying 10.18653/v1/2022.blackboxnlp-1.30 https://aclanthology.org/2022.blackboxnlp-1.30/ 2022-12 356 370 Probing Pretrained Models of Source Codes Sergey Troshin author Nadezhda Chirkova author 2022-12 text Proceedings of the Fifth BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP Jasmijn Bastings editor Yonatan Belinkov editor Yanai Elazar editor Dieuwke Hupkes editor Naomi Saphra editor Sarah Wiegreffe editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication troshin-chirkova-2022-probing 10.18653/v1/2022.blackboxnlp-1.31 https://aclanthology.org/2022.blackboxnlp-1.31/ 2022-12 371 383 Probing the representations of named entities in Transformer-based Language Models Stefan Schouten author Peter Bloem author Piek Vossen author 2022-12 text Proceedings of the Fifth BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP Jasmijn Bastings editor Yonatan Belinkov editor Yanai Elazar editor Dieuwke Hupkes editor Naomi Saphra editor Sarah Wiegreffe editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication schouten-etal-2022-probing 10.18653/v1/2022.blackboxnlp-1.32 https://aclanthology.org/2022.blackboxnlp-1.32/ 2022-12 384 393 Decomposing Natural Logic Inferences for Neural NLI Julia Rozanova author Deborah Ferreira author Mokanarangan Thayaparan author Marco Valentino author Andre Freitas author 2022-12 text Proceedings of the Fifth BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP Jasmijn Bastings editor Yonatan Belinkov editor Yanai Elazar editor Dieuwke Hupkes editor Naomi Saphra editor Sarah Wiegreffe editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication rozanova-etal-2022-decomposing 10.18653/v1/2022.blackboxnlp-1.33 https://aclanthology.org/2022.blackboxnlp-1.33/ 2022-12 394 403 Probing with Noise: Unpicking the Warp and Weft of Embeddings Filip Klubicka author John Kelleher author 2022-12 text Proceedings of the Fifth BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP Jasmijn Bastings editor Yonatan Belinkov editor Yanai Elazar editor Dieuwke Hupkes editor Naomi Saphra editor Sarah Wiegreffe editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication klubicka-kelleher-2022-probing 10.18653/v1/2022.blackboxnlp-1.34 https://aclanthology.org/2022.blackboxnlp-1.34/ 2022-12 404 417 Look to the Right: Mitigating Relative Position Bias in Extractive Question Answering Kazutoshi Shinoda author Saku Sugawara author Akiko Aizawa author 2022-12 text Proceedings of the Fifth BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP Jasmijn Bastings editor Yonatan Belinkov editor Yanai Elazar editor Dieuwke Hupkes editor Naomi Saphra editor Sarah Wiegreffe editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication shinoda-etal-2022-look 10.18653/v1/2022.blackboxnlp-1.35 https://aclanthology.org/2022.blackboxnlp-1.35/ 2022-12 418 425 A Continuum of Generation Tasks for Investigating Length Bias and Degenerate Repetition Darcey Riley author David Chiang author 2022-12 text Proceedings of the Fifth BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP Jasmijn Bastings editor Yonatan Belinkov editor Yanai Elazar editor Dieuwke Hupkes editor Naomi Saphra editor Sarah Wiegreffe editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication riley-chiang-2022-continuum 10.18653/v1/2022.blackboxnlp-1.36 https://aclanthology.org/2022.blackboxnlp-1.36/ 2022-12 426 440 Universal and Independent: Multilingual Probing Framework for Exhaustive Model Interpretation and Evaluation Oleg Serikov author Vitaly Protasov author Ekaterina Voloshina author Viktoria Knyazkova author Tatiana Shavrina author 2022-12 text Proceedings of the Fifth BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP Jasmijn Bastings editor Yonatan Belinkov editor Yanai Elazar editor Dieuwke Hupkes editor Naomi Saphra editor Sarah Wiegreffe editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates (Hybrid) conference publication serikov-etal-2022-universal 10.18653/v1/2022.blackboxnlp-1.37 https://aclanthology.org/2022.blackboxnlp-1.37/ 2022-12 441 456