Knowledge Inheritance for Pre-trained Language Models

Knowledge Inheritance for Pre-trained Language Models Yujia Qin author Yankai Lin author Jing Yi author Jiajie Zhang author Xu Han author Zhengyan Zhang author Yusheng Su author Zhiyuan Liu author Peng Li author Maosong Sun author Jie Zhou author 2022-07 text Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies Marine Carpuat editor Marie-Catherine de Marneffe editor Ivan Vladimir Meza Ruiz editor Association for Computational Linguistics Seattle, United States conference publication qin-etal-2022-knowledge 10.18653/v1/2022.naacl-main.288 https://aclanthology.org/2022.naacl-main.288/ 2022-07 3921 3937