Instruction Pre-Training: Language Models are Supervised Multitask Learners

Instruction Pre-Training: Language Models are Supervised Multitask Learners Daixuan Cheng author Yuxian Gu author Shaohan Huang author Junyu Bi author Minlie Huang author Furu Wei author 2024-11 text Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing Yaser Al-Onaizan editor Mohit Bansal editor Yun-Nung Chen editor Association for Computational Linguistics Miami, Florida, USA conference publication cheng-etal-2024-instruction 10.18653/v1/2024.emnlp-main.148 https://aclanthology.org/2024.emnlp-main.148/ 2024-11 2529 2550