Scaling Laws vs Model Architectures: How does Inductive Bias Influence Scaling?

Scaling Laws vs Model Architectures: How does Inductive Bias Influence Scaling? Yi Tay author Mostafa Dehghani author Samira Abnar author Hyung Chung author William Fedus author Jinfeng Rao author Sharan Narang author Vinh Tran author Dani Yogatama author Donald Metzler author 2023-12 text Findings of the Association for Computational Linguistics: EMNLP 2023 Houda Bouamor editor Juan Pino editor Kalika Bali editor Association for Computational Linguistics Singapore conference publication tay-etal-2023-scaling 10.18653/v1/2023.findings-emnlp.825 https://aclanthology.org/2023.findings-emnlp.825/ 2023-12 12342 12364