Srikar Vardhan Mangadoddi
Author directory2026
Multi-Signal Interpretability Identifies Task-Critical Circuits for Efficient Model Compression
Srikar Vardhan Mangadoddi
Findings of the Association for Computational Linguistics: IJCNLP-AACL 2026
Srikar Vardhan Mangadoddi
Findings of the Association for Computational Linguistics: IJCNLP-AACL 2026
Post-training quantization methods such as GPTQ and AWQ minimize reconstruction error without asking which weights matter for the task. We combine six interpretability signals to select a sparse skeleton of task-critical MLP neurons that is kept at 16-bit while the rest of the model is quantized. On Gemma-2-2B fine-tuned for SQL generation, the 0.54% skeleton with 3-bit MLPs and 8-bit attention retains 100% of baseline-correct outputs at 4.03x compression, versus 75.2% for uniform 4-bit. On Llama-3-8B fine-tuned for Cypher generation, where uniform 4-bit loses 23 points, the 0.46% skeleton recovers 14.4 of them and a random skeleton of equal size recovers none. Three signals are individually effective and three are not, and the effective set differs between models, so the consensus rule provides robustness no single signal does. Selection matters where uniform quantization leaves headroom, which suggests measuring headroom, selecting by consensus, and protecting as a recipe for larger models. GPTQ error compensation degrades 3-bit layouts by 16 to 18 points regardless of protection.