Proceedings of Deep Learning Inside Out (DeeLIO): The 2nd Workshop on Knowledge Extraction and Integration for Deep Learning Architectures

Proceedings of Deep Learning Inside Out (DeeLIO): The 2nd Workshop on Knowledge Extraction and Integration for Deep Learning Architectures Eneko Agirre editor Marianna Apidianaki editor Ivan Vulić editor 2021-06 Association for Computational Linguistics Online text conference publication deelio-2021-deep https://aclanthology.org/2021.deelio-1.0/ Transformer visualization via dictionary learning: contextualized embedding as a linear superposition of transformer factors Zeyu Yun author Yubei Chen author Bruno Olshausen author Yann LeCun author 2021-06 text Proceedings of Deep Learning Inside Out (DeeLIO): The 2nd Workshop on Knowledge Extraction and Integration for Deep Learning Architectures Eneko Agirre editor Marianna Apidianaki editor Ivan Vulić editor Association for Computational Linguistics Online conference publication yun-etal-2021-transformer 10.18653/v1/2021.deelio-1.1 https://aclanthology.org/2021.deelio-1.1/ 2021-06 1 10 Reconstructing Implicit Knowledge with Language Models Maria Becker author Siting Liang author Anette Frank author 2021-06 text Proceedings of Deep Learning Inside Out (DeeLIO): The 2nd Workshop on Knowledge Extraction and Integration for Deep Learning Architectures Eneko Agirre editor Marianna Apidianaki editor Ivan Vulić editor Association for Computational Linguistics Online conference publication becker-etal-2021-reconstructing 10.18653/v1/2021.deelio-1.2 https://aclanthology.org/2021.deelio-1.2/ 2021-06 11 24 Investigating the Effect of Background Knowledge on Natural Questions Vidhisha Balachandran author Bhuwan Dhingra author Haitian Sun author Michael Collins author William Cohen author 2021-06 text Proceedings of Deep Learning Inside Out (DeeLIO): The 2nd Workshop on Knowledge Extraction and Integration for Deep Learning Architectures Eneko Agirre editor Marianna Apidianaki editor Ivan Vulić editor Association for Computational Linguistics Online conference publication balachandran-etal-2021-investigating 10.18653/v1/2021.deelio-1.3 https://aclanthology.org/2021.deelio-1.3/ 2021-06 25 30 Augmenting Topic Aware Knowledge-Grounded Conversations with Dynamic Built Knowledge Graphs Junjie Wu author Hao Zhou author 2021-06 text Proceedings of Deep Learning Inside Out (DeeLIO): The 2nd Workshop on Knowledge Extraction and Integration for Deep Learning Architectures Eneko Agirre editor Marianna Apidianaki editor Ivan Vulić editor Association for Computational Linguistics Online conference publication wu-zhou-2021-augmenting 10.18653/v1/2021.deelio-1.4 https://aclanthology.org/2021.deelio-1.4/ 2021-06 31 39 What Makes My Model Perplexed? A Linguistic Investigation on Neural Language Models Perplexity Alessio Miaschi author Dominique Brunato author Felice Dell’Orletta author Giulia Venturi author 2021-06 text Proceedings of Deep Learning Inside Out (DeeLIO): The 2nd Workshop on Knowledge Extraction and Integration for Deep Learning Architectures Eneko Agirre editor Marianna Apidianaki editor Ivan Vulić editor Association for Computational Linguistics Online conference publication miaschi-etal-2021-makes 10.18653/v1/2021.deelio-1.5 https://aclanthology.org/2021.deelio-1.5/ 2021-06 40 47 How Do BERT Embeddings Organize Linguistic Knowledge? Giovanni Puccetti author Alessio Miaschi author Felice Dell’Orletta author 2021-06 text Proceedings of Deep Learning Inside Out (DeeLIO): The 2nd Workshop on Knowledge Extraction and Integration for Deep Learning Architectures Eneko Agirre editor Marianna Apidianaki editor Ivan Vulić editor Association for Computational Linguistics Online conference publication puccetti-etal-2021-bert 10.18653/v1/2021.deelio-1.6 https://aclanthology.org/2021.deelio-1.6/ 2021-06 48 57 ERNIE-NLI: Analyzing the Impact of Domain-Specific External Knowledge on Enhanced Representations for NLI Lisa Bauer author Lingjia Deng author Mohit Bansal author 2021-06 text Proceedings of Deep Learning Inside Out (DeeLIO): The 2nd Workshop on Knowledge Extraction and Integration for Deep Learning Architectures Eneko Agirre editor Marianna Apidianaki editor Ivan Vulić editor Association for Computational Linguistics Online conference publication bauer-etal-2021-ernie 10.18653/v1/2021.deelio-1.7 https://aclanthology.org/2021.deelio-1.7/ 2021-06 58 69 Enhancing Multiple-Choice Question Answering with Causal Knowledge Dhairya Dalal author Mihael Arcan author Paul Buitelaar author 2021-06 text Proceedings of Deep Learning Inside Out (DeeLIO): The 2nd Workshop on Knowledge Extraction and Integration for Deep Learning Architectures Eneko Agirre editor Marianna Apidianaki editor Ivan Vulić editor Association for Computational Linguistics Online conference publication dalal-etal-2021-enhancing 10.18653/v1/2021.deelio-1.8 https://aclanthology.org/2021.deelio-1.8/ 2021-06 70 80 Low Anisotropy Sense Retrofitting (LASeR) : Towards Isotropic and Sense Enriched Representations Geetanjali Bihani author Julia Rayz author 2021-06 text Proceedings of Deep Learning Inside Out (DeeLIO): The 2nd Workshop on Knowledge Extraction and Integration for Deep Learning Architectures Eneko Agirre editor Marianna Apidianaki editor Ivan Vulić editor Association for Computational Linguistics Online conference publication bihani-rayz-2021-low 10.18653/v1/2021.deelio-1.9 https://aclanthology.org/2021.deelio-1.9/ 2021-06 81 95 KW-ATTN: Knowledge Infused Attention for Accurate and Interpretable Text Classification Hyeju Jang author Seojin Bang author Wen Xiao author Giuseppe Carenini author Raymond Ng author Young ji Lee author 2021-06 text Proceedings of Deep Learning Inside Out (DeeLIO): The 2nd Workshop on Knowledge Extraction and Integration for Deep Learning Architectures Eneko Agirre editor Marianna Apidianaki editor Ivan Vulić editor Association for Computational Linguistics Online conference publication jang-etal-2021-kw 10.18653/v1/2021.deelio-1.10 https://aclanthology.org/2021.deelio-1.10/ 2021-06 96 107 Multi-input Recurrent Independent Mechanisms for leveraging knowledge sources: Case studies on sentiment analysis and health text mining Parsa Bagherzadeh author Sabine Bergler author 2021-06 text Proceedings of Deep Learning Inside Out (DeeLIO): The 2nd Workshop on Knowledge Extraction and Integration for Deep Learning Architectures Eneko Agirre editor Marianna Apidianaki editor Ivan Vulić editor Association for Computational Linguistics Online conference publication bagherzadeh-bergler-2021-multi 10.18653/v1/2021.deelio-1.11 https://aclanthology.org/2021.deelio-1.11/ 2021-06 108 118 What BERTs and GPTs know about your brand? Probing contextual language models for affect associations Vivek Srivastava author Stephen Pilli author Savita Bhat author Niranjan Pedanekar author Shirish Karande author 2021-06 text Proceedings of Deep Learning Inside Out (DeeLIO): The 2nd Workshop on Knowledge Extraction and Integration for Deep Learning Architectures Eneko Agirre editor Marianna Apidianaki editor Ivan Vulić editor Association for Computational Linguistics Online conference publication srivastava-etal-2021-berts 10.18653/v1/2021.deelio-1.12 https://aclanthology.org/2021.deelio-1.12/ 2021-06 119 128 Attention vs non-attention for a Shapley-based explanation method Tom Kersten author Hugh Mee Wong author Jaap Jumelet author Dieuwke Hupkes author 2021-06 text Proceedings of Deep Learning Inside Out (DeeLIO): The 2nd Workshop on Knowledge Extraction and Integration for Deep Learning Architectures Eneko Agirre editor Marianna Apidianaki editor Ivan Vulić editor Association for Computational Linguistics Online conference publication kersten-etal-2021-attention 10.18653/v1/2021.deelio-1.13 https://aclanthology.org/2021.deelio-1.13/ 2021-06 129 139 Predicting Numerals in Natural Language Text Using a Language Model Considering the Quantitative Aspects of Numerals Taku Sakamoto author Akiko Aizawa author 2021-06 text Proceedings of Deep Learning Inside Out (DeeLIO): The 2nd Workshop on Knowledge Extraction and Integration for Deep Learning Architectures Eneko Agirre editor Marianna Apidianaki editor Ivan Vulić editor Association for Computational Linguistics Online conference publication sakamoto-aizawa-2021-predicting 10.18653/v1/2021.deelio-1.14 https://aclanthology.org/2021.deelio-1.14/ 2021-06 140 150