Incremental pre-training from smaller language models

Incremental pre-training from smaller language models Han Zhang author Hui Wang author Ruifeng Xu author 2024-08 text Proceedings of the 10th SIGHAN Workshop on Chinese Language Processing (SIGHAN-10) Kam-Fai Wong editor Min Zhang editor Ruifeng Xu editor Jing Li editor Zhongyu Wei editor Lin Gui editor Bin Liang editor Runcong Zhao editor Association for Computational Linguistics Bangkok, Thailand conference publication zhang-etal-2024-incremental https://aclanthology.org/2024.sighan-1.5/ 2024-08 36 44