Thuy Dung Nguyen

Author directory

2026

As large language models are deployed at scale, the ability to selectively remove knowledge has become critical for privacy, safety, and legal compliance. Existing post-training unlearning methods suffer from a persistent tension: unbounded divergence signals over-unlearn, degrading utility and producing incoherent outputs, while fixed sample-agnostic targets and reference-relative penalties under-unlearn, leaving traces recoverable under paraphrase or membership-inference attacks. We attribute both failures to a common structural cause: the forgetting objective is decoupled from any sample- or parameter-level notion of what retention requires. We present FLOUR (Forgetting via Learned On-manifold Unlearning Representations), a latent unlearning framework in which a lightweight encoder produces a per-sample suppression direction. This direction is anchored to the null region of the reference model’s activations, keeping it on-manifold and disentangled from retention-critical directions, which enables forgetting while preserving coherent generation and enhancing privacy. Results on the Open-Unlearning benchmark suite show that FLOUR most closely matches the retrain oracle across the unlearning trilemma of forgetting, retention, and privacy, substantially outperforming prior baselines. Our code is publicly available at https://github.com/ judydnguyen/flour-unlearning.

2010