Improving Generalization of Pre-trained Language Models via Stochastic Weight Averaging

Improving Generalization of Pre-trained Language Models via Stochastic Weight Averaging Peng Lu author Ivan Kobyzev author Mehdi Rezagholizadeh author Ahmad Rashid author Ali Ghodsi author Phillippe Langlais author 2022-12 text Findings of the Association for Computational Linguistics: EMNLP 2022 Yoav Goldberg editor Zornitsa Kozareva editor Yue Zhang editor Association for Computational Linguistics Abu Dhabi, United Arab Emirates conference publication lu-etal-2022-improving 10.18653/v1/2022.findings-emnlp.363 https://aclanthology.org/2022.findings-emnlp.363/ 2022-12 4948 4954