RetroMAE: Pre-Training Retrieval-oriented Language Models Via Masked Auto-Encoder

RetroMAE: Pre-Training Retrieval-oriented Language Models Via Masked Auto-Encoder Shitao Xiao author Zheng Liu author Yingxia Shao author Zhao Cao author 2022-12 text Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing Yoav Goldberg editor Zornitsa Kozareva editor Yue Zhang editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates conference publication xiao-etal-2022-retromae 10.18653/v1/2022.emnlp-main.35 https://aclanthology.org/2022.emnlp-main.35/ 2022-12 538 548