DecBERT: Enhancing the Language Understanding of BERT with Causal Attention Masks

DecBERT: Enhancing the Language Understanding of BERT with Causal Attention Masks Ziyang Luo author Yadong Xi author Jing Ma author Zhiwei Yang author Xiaoxi Mao author Changjie Fan author Rongsheng Zhang author 2022-07 text Findings of the Association for Computational Linguistics: NAACL 2022 Marine Carpuat editor Marie-Catherine de Marneffe editor Ivan Vladimir Meza Ruiz editor Association for Computational Linguistics Seattle, United States conference publication luo-etal-2022-decbert 10.18653/v1/2022.findings-naacl.89 https://aclanthology.org/2022.findings-naacl.89/ 2022-07 1185 1197