Effective Long-Context Scaling of Foundation Models Wenhan Xiong author Jingyu Liu author Igor Molybog author Hejia Zhang author Prajjwal Bhargava author Rui Hou author Louis Martin author Rashi Rungta author Karthik Abinav Sankararaman author Barlas Oguz author Madian Khabsa author Han Fang author Yashar Mehdad author Sharan Narang author Kshitiz Malik author Angela Fan author Shruti Bhosale author Sergey Edunov author Mike Lewis author Sinong Wang author Hao Ma author 2024-06 text Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers) Kevin Duh editor Helena Gomez editor Steven Bethard editor Association for Computational Linguistics Mexico City, Mexico conference publication xiong-etal-2024-effective 10.18653/v1/2024.naacl-long.260 https://aclanthology.org/2024.naacl-long.260/ 2024-06 4643 4663