Zhiguo Yang

Author directory

Other people with similar names: Zhiguo Yang, Zhiguo Yang


2026

Layer pruning aims to accelerate the inference of Large Language Models on general hardware by removing less important Transformer layers. However, naively deleting layers typically degrades model performance. To reduce this degradation, prior work approximates removed layers with replacement components such as linear layers. These approaches often require large datasets and heavy replacement modules, which increase computational and memory costs. Their time complexity also restricts them to static, consecutive-layer pruning. In this work, we introduce a novel method, Superior layer Pruning performance by Super-fast Recovery (SPSR), which uses Pearson correlation coefficients to quantify a layer’s recovery ability and applies a super-fast fine-tuning procedure with a lightweight replacement component. SPSR readily extends to non-consecutive pruning and to dynamic pruning. Experimental results show that SPSR achieves performance competitive with state-of-the-art methods while substantially improving recovery efficiency.