%0 Conference Proceedings %T CoCA: Fusing Position Embedding with Collinear Constrained Attention in Transformers for Long Context Window Extending %A Zhu, Shiyi %A Ye, Jing %A Jiang, Wei %A Xue, Siqiao %A Zhang, Qi %A Wu, Yifan %A Li, Jianguo %Y Ku, Lun-Wei %Y Martins, Andre %Y Srikumar, Vivek %S Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) %D 2024 %8 August %I Association for Computational Linguistics %C Bangkok, Thailand %F zhu-etal-2024-coca %R 10.18653/v1/2024.acl-long.233 %U https://aclanthology.org/2024.acl-long.233/ %U https://doi.org/10.18653/v1/2024.acl-long.233 %P 4247-4262