Efficient GPT Model Pre-training using Tensor Train Matrix Representation

Efficient GPT Model Pre-training using Tensor Train Matrix Representation Viktoriia Chekalina author Georgiy Novikov author Julia Gusak author Alexander Panchenko author Ivan Oseledets author 2023-12 text Proceedings of the 37th Pacific Asia Conference on Language, Information and Computation Chu-Ren Huang editor Yasunari Harada editor Jong-Bok Kim editor Si Chen editor Yu-Yin Hsu editor Emmanuele Chersoni editor Pranav A editor Winnie Huiheng Zeng editor Bo Peng editor Yuxi Li editor Junlin Li editor Association for Computational Linguistics Hong Kong, China conference publication chekalina-etal-2023-efficient https://aclanthology.org/2023.paclic-1.60/ 2023-12 600 608