Found in the middle: Calibrating Positional Attention Bias Improves Long Context Utilization

Found in the middle: Calibrating Positional Attention Bias Improves Long Context Utilization Cheng-Yu Hsieh author Yung-Sung Chuang author Chun-Liang Li author Zifeng Wang author Long Le author Abhishek Kumar author James Glass author Alexander Ratner author Chen-Yu Lee author Ranjay Krishna author Tomas Pfister author 2024-08 text Findings of the Association for Computational Linguistics: ACL 2024 Lun-Wei Ku editor Andre Martins editor Vivek Srikumar editor Association for Computational Linguistics Bangkok, Thailand conference publication hsieh-etal-2024-found 10.18653/v1/2024.findings-acl.890 https://aclanthology.org/2024.findings-acl.890/ 2024-08 14982 14995