RelayAttention for Efficient Large Language Model Serving with Long System Prompts Lei Zhu author Xinjiang Wang author Wayne Zhang author Rynson Lau author 2024-08 text Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) Lun-Wei Ku editor Andre Martins editor Vivek Srikumar editor Association for Computational Linguistics Bangkok, Thailand conference publication zhu-etal-2024-relayattention 10.18653/v1/2024.acl-long.270 https://aclanthology.org/2024.acl-long.270/ 2024-08 4945 4957