NeuroPrune: A Neuro-inspired Topological Sparse Training Algorithm for Large Language Models

Amit Dhurandhar, Tejaswini Pedapati, Ronny Luss, Soham Dan, Aurelie Lozano, Payel Das, Georgios Kollias


Abstract
Transformer-based Language Models have become ubiquitous in Natural Language Processing (NLP) due to their impressive performance on various tasks. However, expensive training as well as inference remains a significant impediment to their widespread applicability. While enforcing sparsity at various levels of the model architecture has found promise in addressing scaling and efficiency issues, there remains a disconnect between how sparsity affects network topology. Inspired by brain neuronal networks, we explore sparsity approaches through the lens of network topology. Specifically, we exploit mechanisms seen in biological networks, such as preferential attachment and redundant synapse pruning, and show that principled, model-agnostic sparsity approaches are performant and efficient across diverse NLP tasks, spanning both classification (such as natural language inference) and generation (summarization, machine translation), despite our sole objective not being optimizing performance. NeuroPrune is competitive with (or sometimes superior to) baselines on performance and can be up to 10x faster in terms of training time for a given level of sparsity, simultaneously exhibiting measurable improvements in inference time in many cases.
Anthology ID:
2024.findings-acl.142
Volume:
Findings of the Association for Computational Linguistics: ACL 2024
Month:
August
Year:
2024
Address:
Bangkok, Thailand
Editors:
Lun-Wei Ku, Andre Martins, Vivek Srikumar
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
2416–2430
Language:
URL:
https://aclanthology.org/2024.findings-acl.142
DOI:
10.18653/v1/2024.findings-acl.142
Bibkey:
Cite (ACL):
Amit Dhurandhar, Tejaswini Pedapati, Ronny Luss, Soham Dan, Aurelie Lozano, Payel Das, and Georgios Kollias. 2024. NeuroPrune: A Neuro-inspired Topological Sparse Training Algorithm for Large Language Models. In Findings of the Association for Computational Linguistics: ACL 2024, pages 2416–2430, Bangkok, Thailand. Association for Computational Linguistics.
Cite (Informal):
NeuroPrune: A Neuro-inspired Topological Sparse Training Algorithm for Large Language Models (Dhurandhar et al., Findings 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.findings-acl.142.pdf