Shall We Pretrain Autoregressive Language Models with Retrieval? A Comprehensive Study Boxin Wang author Wei Ping author Peng Xu author Lawrence McAfee author Zihan Liu author Mohammad Shoeybi author Yi Dong author Oleksii Kuchaiev author Bo Li author Chaowei Xiao author Anima Anandkumar author Bryan Catanzaro author 2023-12 text Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing Houda Bouamor editor Juan Pino editor Kalika Bali editor Association for Computational Linguistics Singapore conference publication wang-etal-2023-shall 10.18653/v1/2023.emnlp-main.482 https://aclanthology.org/2023.emnlp-main.482/ 2023-12 7763 7786