Scalable Data Ablation Approximations for Language Models through Modular Training and Merging

Scalable Data Ablation Approximations for Language Models through Modular Training and Merging Clara Na author Ian Magnusson author Ananya Harsh Jha author Tom Sherborne author Emma Strubell author Jesse Dodge author Pradeep Dasigi author 2024-11 text Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing Yaser Al-Onaizan editor Mohit Bansal editor Yun-Nung Chen editor Association for Computational Linguistics Miami, Florida, USA conference publication na-etal-2024-scalable 10.18653/v1/2024.emnlp-main.1176 https://aclanthology.org/2024.emnlp-main.1176/ 2024-11 21125 21141