%0 Conference Proceedings %T RealFormer: Transformer Likes Residual Attention %A He, Ruining %A Ravula, Anirudh %A Kanagal, Bhargav %A Ainslie, Joshua %Y Zong, Chengqing %Y Xia, Fei %Y Li, Wenjie %Y Navigli, Roberto %S Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021 %D 2021 %8 August %I Association for Computational Linguistics %C Online %F he-etal-2021-realformer %R 10.18653/v1/2021.findings-acl.81 %U https://aclanthology.org/2021.findings-acl.81 %U https://doi.org/10.18653/v1/2021.findings-acl.81 %P 929-943