Pre-training Language Models with Deterministic Factual Knowledge Shaobo Li author Xiaoguang Li author Lifeng Shang author Chengjie Sun author Bingquan Liu author Zhenzhou Ji author Xin Jiang author Qun Liu author 2022-12 text Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing Yoav Goldberg editor Zornitsa Kozareva editor Yue Zhang editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates conference publication li-etal-2022-pre-training 10.18653/v1/2022.emnlp-main.764 https://aclanthology.org/2022.emnlp-main.764/ 2022-12 11118 11131