Resonance RoPE: Improving Context Length Generalization of Large Language Models

Resonance RoPE: Improving Context Length Generalization of Large Language Models Suyuchen Wang author Ivan Kobyzev author Peng Lu author Mehdi Rezagholizadeh author Bang Liu author 2024-08 text Findings of the Association for Computational Linguistics: ACL 2024 Lun-Wei Ku editor Andre Martins editor Vivek Srikumar editor Association for Computational Linguistics Bangkok, Thailand conference publication wang-etal-2024-resonance 10.18653/v1/2024.findings-acl.32 https://aclanthology.org/2024.findings-acl.32/ 2024-08 586 598