SlimFit: Memory-Efficient Fine-Tuning of Transformer-based Models Using Training Dynamics

SlimFit: Memory-Efficient Fine-Tuning of Transformer-based Models Using Training Dynamics Arash Ardakani author Altan Haan author Shangyin Tan author Doru Thom Popovici author Alvin Cheung author Costin Iancu author Koushik Sen author 2024-06 text Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers) Kevin Duh editor Helena Gomez editor Steven Bethard editor Association for Computational Linguistics Mexico City, Mexico conference publication ardakani-etal-2024-slimfit 10.18653/v1/2024.naacl-long.345 https://aclanthology.org/2024.naacl-long.345/ 2024-06 6218 6236