Search: “safety”

Proximal State Nudging: Reducing Skill Atrophy from AI Assistance

arXiv:2605.20355v1 Announce Type: cross Abstract: Skill atrophy, the gradual decline of human capability under AI assistance, poses a safety risk in shared-control of semi-autonomous systems, where op

21 May 2026

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Shipping features to production just got easier with new feature flags in AppLifecycle Manager

DGX agent

Many development teams are familiar with the hesitation that comes right before pushing a new feature live. As AI helps developers write code faster, the gap between rapid code generation and safe pro

safetygoogle-cloud-ai

21 May 2026

Faster-GCG: Efficient Discrete Optimization Jailbreak Attacks against Aligned Large Language Models

arXiv:2410.15362v2 Announce Type: replace-cross Abstract: Aligned Large Language Models (LLMs) have attracted significant attention for their safety, particularly in the context of jailbreak attacks t

FlowErase-RL: Rethinking Concept Erasure as Reward Optimization in Flow Matching Models

arXiv:2605.19739v1 Announce Type: new Abstract: Recent advances in flow matching models have significantly improved text-to-image generation quality, but also introduce growing safety risks due to the

Hard-Label Black-Box Attacks on 3D Point Clouds

arXiv:2412.00404v2 Announce Type: replace Abstract: With the maturity of depth sensors in various 3D safety-critical applications, 3D point cloud models have been shown to be vulnerable to adversarial

Implicit Action Chunking for Smooth Continuous Control

arXiv:2605.19592v1 Announce Type: cross Abstract: Reinforcement learning often produces high-frequency oscillatory control signals that undermine the safety and stability required for physical deploym

Improved visual-information-driven model for crowd simulation and its modular application

arXiv:2504.03758v4 Announce Type: replace-cross Abstract: Crowd movement simulation is crucial for pedestrian safety management and facility design. Data-driven models offer the potential to improve r

Sampling-Based Safe Reinforcement Learning

arXiv:2605.19469v1 Announce Type: cross Abstract: Safe exploration remains a fundamental challenge in reinforcement learning (RL), limiting the deployment of RL agents in the real world. We propose Sa

Activation Steering with a Feedback Controller

arXiv:2510.04309v3 Announce Type: replace Abstract: Controlling the behaviors of large language models (LLM) is fundamental to their safety alignment and reliable deployment. However, existing steerin

Assessing Localization Technologies for Pedestrian Collision Avoidance

arXiv:2605.18295v1 Announce Type: new Abstract: Robust pedestrian safety is crucial to the next-generation of intelligent transportation systems. Such systems rely on active pedestrian localization an

Assured autonomy: How operations research powers and orchestrates generative AI systems

arXiv:2512.23978v2 Announce Type: replace Abstract: Generative artificial intelligence (GenAI) is shifting from conversational assistants toward agentic systems -- autonomous decision-making systems t

Model Releases

Constrained Policy Optimization via Sampling-Based Weight-Space Projection

model-releasesarxiv-cs-lg

arXiv:2512.13788v2 Announce Type: replace Abstract: Safety-critical learning requires policies that improve performance without leaving the safe operating regime. We study constrained policy learning

Density-Ratio Weighted Behavioral Cloning: Learning Control Policies from Corrupted Datasets

arXiv:2510.01479v2 Announce Type: replace Abstract: Offline reinforcement learning (RL) enables policy optimization from fixed datasets, making it suitable for safety-critical applications where onlin

Evaluating AI Alignment in LLMs: Output Analysis of Value Priorities Across 75 Models with Human Benchmarking

arXiv:2506.12617v4 Announce Type: replace Abstract: Large language models (LLMs) are increasingly used in human-AI interaction research and practice, yet existing capability and safety benchmarks reve

Forgetting is Competition: Rethinking Unlearning as Representation Interference in Diffusion Models

arXiv:2603.00975v2 Announce Type: replace-cross Abstract: Deployed text-to-image diffusion models increasingly require post-hoc concept unlearning for copyright claims, artist opt-outs, safety updates

ISEP: Implicit Support Expansion for Offline Reinforcement Learning via Stochastic Policy Optimization

arXiv:2605.18320v1 Announce Type: cross Abstract: Offline reinforcement learning methods typically enforce strict constraints to ensure safety; yet this rigidity often prevents the discovery of optima

Keeping an Eye on AI: A Framework for Effective Human Oversight of AI Systems

arXiv:2605.16278v1 Announce Type: cross Abstract: The use of Artificial Intelligence (AI) in high-risk, decision-making scenarios presents technical, safety, and normative challenges; problems that ma

Meltdown: Circuits and Bifurcations in Point-Cloud-Conditioned 3D Diffusion Transformers

arXiv:2602.11130v2 Announce Type: replace-cross Abstract: Sparse point clouds are a common input modality for 3D surface reconstruction, including in safety-critical settings such as surgical navigati

Semantic Smoothing via Novel View Synthesis for Robust SAR Image Classification

arXiv:2605.16440v1 Announce Type: cross Abstract: Deep neural networks are vulnerable to adversarial perturbations, limiting deployment in safety-critical applications such as synthetic aperture radar

Uncertainty Reliability Under Domain Shift: An Investigation for Data-Driven Blood Pressure Estimation in Photoplethysmography

arXiv:2605.18008v1 Announce Type: new Abstract: Uncertainty quantification (UQ) is critical for safety-critical domains like healthcare, yet it is rarely evaluated under realistic out-of-distribution

Model Releases

3DEditSafe: Defending 3D Editing Pipelines from Unsafe Generation

model-releasesarxiv-cs-cv

arXiv:2605.15398v1 Announce Type: cross Abstract: Recent advances in 3D generative editing, particularly pipelines based on 3D Gaussian Splatting (3DGS), have achieved high-fidelity, multi-view-consis

Learning Context-conditioned Gaussian Overbounds for Convolution-Based Uncertainty Propagation

arXiv:2605.15789v1 Announce Type: new Abstract: Uncertainty quantification is essential in safety-critical settings--from autonomous driving to aviation, finance, and health--where decisions must rely

Propagating Unsafe Actions in LLM Controlled Multi-Robot Collaboration via Single Robot Compromise

arXiv:2605.15641v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used as general planners in embodied intelligence, enabling high level coordination and low level task pla

Towards a more realistic evaluation of machine learning models for bearing fault diagnosis

arXiv:2509.22267v4 Announce Type: replace Abstract: Reliable detection of bearing faults is essential for maintaining the safety and operational efficiency of rotating machinery. While recent advances

This was always and only the sole and exclusive purpose of the UK online censorship act, to help Labour nuke its enemies

This was always and only the sole and exclusive purpose of the UK online censorship act, to help Labour nuke its enemies 🚨 Labour is using the “Online Safety Act” to silence political opponents, and T

safetyelon-musk--x

17 May 2026

Do Reasoning LLMs Refuse What They Infer in Long Contexts?

arXiv:2602.08874v2 Announce Type: replace Abstract: Long-context LLMs can infer objectives that are not stated explicitly. This capability is useful for reasoning over documents, code, retrieved evide

safetyarxiv-cs-cl

Exploring Geographic Relative Space in Large Language Models through Activation Patching

arXiv:2605.14535v1 Announce Type: new Abstract: The increased use of Large Language Models (LLMs) in geography raises substantial questions about the safety of integrating these tools across a wide ra

One Step to the Side: Why Defenses Against Malicious Finetuning Fail Under Adaptive Adversaries

arXiv:2605.14605v1 Announce Type: cross Abstract: Model providers increasingly release open weights or allow users to fine-tune foundation models through APIs. Although these models are safety-aligned

Precise Verification of Transformers through ReLU-Catalyzed Abstraction Refinement

arXiv:2605.14294v1 Announce Type: new Abstract: Formal verification of transformers has become increasingly important due to their widespread deployment in safety-critical applications. Compared to cl

Systematic Discovery of Semantic Attacks in Online Map Construction through Conditional Diffusion

arXiv:2605.14396v1 Announce Type: new Abstract: Autonomous vehicles depend on online HD map construction to perceive lane boundaries, dividers, and pedestrian crossings -- safety-critical road element

A Data Efficiency Study of Synthetic Fog for Object Detection Using the Clear2Fog Pipeline

arXiv:2605.12608v1 Announce Type: new Abstract: Object detection in adverse weather is critical for the safety of autonomous vehicles; however, the scarcity of labelled, real-world foggy data remains

Belief-Space Residual Risk for Automated Driving under Localization Uncertainty

arXiv:2605.12710v1 Announce Type: new Abstract: Residual risk metrics have recently been introduced to assess the safety implications of automated driving systems. Existing approaches typically assume

Digital Twins as Synthetic Controls in Single-Arm Trials

arXiv:2605.12832v1 Announce Type: cross Abstract: Single-arm trials are an important study design for evaluating drug efficacy and safety without enrolling patients into a control arm. Although they d

Humanwashing -- It Should Leave You Feeling Dirty

arXiv:2605.13723v1 Announce Type: cross Abstract: The phrase 'human in the loop' is increasingly used to imply a sense of safety in relation to AI decision systems. It shouldn't. There are contexts wh

Integration of an Agent Model into an Open Simulation Architecture for Scenario-Based Testing of Automated Vehicles

arXiv:2605.13539v1 Announce Type: new Abstract: Simulative and scenario-based testing are crucial methods in the safety assurance for automated driving systems. To ensure that simulation results are r

NeuroRisk: Physics-Informed Neural Optimization for Risk-Aware Traffic Engineering

arXiv:2605.12862v1 Announce Type: cross Abstract: In production Wide-Area Networks (WANs), correlated failures dominate availability losses, forcing operators to reserve large safety margins that leav

Quantifying Sensitivity for Tree Ensembles: A symbolic and compositional approach

arXiv:2605.13830v1 Announce Type: new Abstract: Decision tree ensembles (DTE) are a popular model for a wide range of AI classification tasks, used in multiple safety critical domains, and hence verif

Quantitative Certification of Agentic Tool Selection

arXiv:2510.03992v2 Announce Type: replace-cross Abstract: Large language models (LLMs) are increasingly deployed in agentic systems, where a fundamental task is mapping user intents to relevant extern

SPOT: Selective Prompt Projection via Total Variation for Inference-Only Safe Text-to-Image Generation

arXiv:2602.00616v3 Announce Type: replace Abstract: Text-to-Image (T2I) diffusion models enable high quality open ended synthesis, but practical use requires suppressing unsafe generations while prese

Watermarking Should Be Treated as a Monitoring Primitive

arXiv:2605.13095v1 Announce Type: cross Abstract: Watermarking is widely proposed for provenance, attribution, and safety monitoring in generative models, yet is typically evaluated only under adversa

Few-Shot Synthetic Data Generation with Diffusion Models for Downstream Vision Tasks

arXiv:2605.11898v1 Announce Type: new Abstract: Class imbalance is a persistent challenge in visual recognition, particularly in safety-critical domains where collecting positive examples is expensive

Interpreting Context-Aware Human Preferences for Multi-Objective Robot Navigation

arXiv:2603.17510v2 Announce Type: replace Abstract: Robots operating in human-shared environments must not only achieve task-level navigation objectives such as safety and efficiency, but also adapt t

Persona-Conditioned Adversarial Prompting: Multi-Identity Red-Teaming for Adversarial Discovery and Mitigation

arXiv:2605.11730v1 Announce Type: new Abstract: Automated red-teaming for LLMs often discovers narrow attack slices, missing diverse real-world threats, and yielding insufficient data for safety fine-

Prototype Fusion: A Training-Free Multi-Layer Approach to OOD Detection

arXiv:2603.23677v2 Announce Type: replace Abstract: Deep learning models are increasingly deployed in safety-critical applications, where reliable out-of-distribution (OOD) detection is essential to e

The Evaluation Differential: When Frontier AI Models Recognise They Are Being Tested

arXiv:2605.11496v1 Announce Type: cross Abstract: Recent published evidence from frontier laboratories shows that contemporary AI models can recognise evaluation contexts, latently represent them, and

Toxicity Detection Should Measure Contextual Harm, Not Text-Intrinsic Badness

arXiv:2503.16072v4 Announce Type: replace-cross Abstract: Toxicity detection has become core safety infrastructure for online moderation, dataset filtering, and deployed language-model systems. Yet mo

safetyarxiv-cs-cl

VNDUQE: Information-Theoretic Novelty Detection using Deep Variational Information Bottleneck

arXiv:2605.11551v1 Announce Type: cross Abstract: Detecting out-of-distribution (OOD) samples is critical for safe deployment of neural networks in safety-critical applications. While maximum softmax

Agent-Sentry: Bounding LLM Agents via Execution Provenance

arXiv:2603.22868v2 Announce Type: replace-cross Abstract: Agentic computing systems, while immensely capable, raise serious security, privacy, and safety concerns. A key issue is that the full set of