Model-Generated Pretraining Signals Improves Zero-Shot Generalization of Text-to-Text Transformers

Model-Generated Pretraining Signals Improves Zero-Shot Generalization of Text-to-Text Transformers Linyuan Gong author Chenyan Xiong author Xiaodong Liu author Payal Bajaj author Yiqing Xie author Alvin Cheung author Jianfeng Gao author Xia Song author 2023-07 text Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) Anna Rogers editor Jordan Boyd-Graber editor Naoaki Okazaki editor Association for Computational Linguistics Toronto, Canada conference publication gong-etal-2023-model 10.18653/v1/2023.acl-long.724 https://aclanthology.org/2023.acl-long.724/ 2023-07 12933 12950