Current evaluations of memorization in Large Language Models (LLMs) predominantly rely on overlap ratios, which fails to distinguish between sporadic token matches and reliable, sequential recall. What’s more, these methods become inapplicable in practical scenarios where ground truth suffixes is unavailable. To address these limitations, we propose a paradigm shift from quantifying "rates" to determining the Effective Memorization Length—the distinct boundary where a model transitions from faithful recall to open-ended generation. We introduce a Ensemble Memorization Classifier that leverages internal states from the LLM to estimate this boundary in a reference-free manner. This framework enables Confidence-Aware Generation Control, allowing to extract high-precision suffixes by dynamically truncating sequences precisely at the memorization boundary. Furthermore, we demonstrate that this boundary is optimizable; by integrating our classifier as a reward model within a reinforcement learning framework, we actively extend the average effective length of generated suffixes. Experiments on the GPT-Neo and Pythia families demonstrate that our approach not only accurately filters non-memorization tokens but also effectively "unlocks" deeper chains of memorized knowledge, transforming memorization from an unpredictable risk into a controllable utility.

The evolution of pre-trained large language models (LLMs) has significantly transformed natural language processing. However, these advancements pose challenges, particularly the unintended memorization of training data, which raises ethical and privacy concerns. While prior research has largely focused on mitigating memorization or extracting memorized information, the deliberate control of memorization has been underexplored. This study addresses this gap by introducing a novel and unified gradient-based weight pruning framework to freely control memorization rates in LLMs. Our method enables fine-grained control over pruning parameters, allowing models to suppress or enhance memorization based on application-specific requirements. Experimental results demonstrate that our approach effectively balances the trade-offs between memorization and generalization, with an increase of up to 89.3% in Fractional ER suppression and 40.9% in Exact ER amplification compared to the original models.