Jailbreaking the Matrix: Nullspace Steering for Controlled Model Subversion

arXiv:2604.10326v1 Announce Type: cross Abstract: Large language models remain vulnerable to jailbreak attacks -- inputs designed to bypass safety mechanisms and elicit harmful responses -- despite advances in alignment and instruction tuning. We propose Head-Masked Nullspace Steering (HMNS), a circuit-level intervention that (i) identifies attention heads most causally responsible for a model's default behavior, (ii) suppresses their write paths via targeted column masking, and (iii) injects a perturbation constrained to the orthogonal complement of the muted subspace. HMNS operates in a closed-loop detection-intervention cycle, re-identifying causal heads and reapplying interventions across multiple decoding attempts. Across multiple jailbreak benchmarks, strong safety defenses, and widely used language models, HMNS attains state-of-the-art attack success rates with fewer queries than prior methods. Ablations confirm that nullspace-constrained injection, residual norm scaling, and iterative re-identification are key to its effectiveness. To our knowledge, this is the first jailbreak method to leverage geometry-aware, interpretability-informed interventions, highlighting a new paradigm for controlled model steering and adversarial safety circumvention.

Related

• Large Language Models Generate Harmful Content Using a Distinct, Unified Mechanism
• Backdoors in RLVR: Jailbreak Backdoors in LLMs From Verifiable Reward
• Deliberative Alignment is Deep, but Uncertainty Remains: Inference time safety improvement in reasoning via attribution of unsafe behavior to base model
• Mosaic: Multimodal Jailbreak against Closed-Source VLMs via Multi-View Ensemble Optimization
• GRM: Utility-Aware Jailbreak Attacks on Audio LLMs via Gradient-Ratio Masking
• Re-Mask and Redirect: Exploiting Denoising Irreversibility in Diffusion Language Models

Source: arXiv cs.AI | 2026-04-14