Behavioral problems in deployed LLMs are often discovered when only limited supervision is available and repeating full alignment training is impractical. Existing post-hoc methods have complementary limitations: activation steering lacks input adaptivity, while standard LoRA learns without an explicit behavioral direction prior and can be unstable in low-data settings. We introduce PR-LoRA, a direction-regularized LoRA variant that initializes LoRA B matrices with per-layer contrastive behavioral directions and anchors them with an L₂ penalty, while leaving A freely trainable. We evaluate PR-LoRA on seven CAA behaviors across Qwen3 and LLaMA models against activation steering and parameter-efficient adaptation baselines. On Qwen3-8B, PR-LoRA lowers the seven-behavior macro-average undesirable-behavior score from .405 to .374 relative to standard LoRA, a 7.8% relative reduction, and outperforms DPO-LoRA and LoReFT under the tested low-update budget.