SOLAR 10.7B: Scaling Large Language Models with Simple yet Effective Depth Up-Scaling

SOLAR 10.7B: Scaling Large Language Models with Simple yet Effective Depth Up-Scaling Sanghoon Kim author Dahyun Kim author Chanjun Park author Wonsung Lee author Wonho Song author Yunsu Kim author Hyeonwoo Kim author Yungi Kim author Hyeonju Lee author Jihoo Kim author Changbae Ahn author Seonghoon Yang author Sukyung Lee author Hyunbyung Park author Gyoungjin Gim author Mikyoung Cha author Hwalsuk Lee author Sunghun Kim author 2024-06 text Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 6: Industry Track) Yi Yang editor Aida Davani editor Avi Sil editor Anoop Kumar editor Association for Computational Linguistics Mexico City, Mexico conference publication kim-etal-2024-solar 10.18653/v1/2024.naacl-industry.3 https://aclanthology.org/2024.naacl-industry.3/ 2024-06 23 35