safety

Note that as of last summer Waymo said that LLMs/VLMs were experimental, and that their foundation model then could “process only a small am…

Note that as of last summer Waymo said that LLMs/VLMs were experimental, and that their foundation model then could “process only a small amount of image frames, does not incorporate accurate 3D sensi

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Safety

Nudging Beyond the Comfort Zone: Efficient Strategy-Guided Exploration for RLVR

DGX agent

arXiv:2605.15726v1 Announce Type: new Abstract: Reinforcement learning with verifiable rewards (RLVR) has emerged as a scalable paradigm for improving the reasoning capabilities of large language mode

safetyarxiv-cs-ai

18 May 2026

Offline Reinforcement Learning with Universal Horizon Models

arXiv:2605.15603v1 Announce Type: cross Abstract: Model-based reinforcement learning (RL) offers a compelling approach to offline RL by enabling value learning on imagined on-policy trajectories. Howe

OHP-RL: Online Human Preference as Guidance in Reinforcement Learning for Robot Manipulation

arXiv:2605.15971v1 Announce Type: new Abstract: While reinforcement learning (RL) enables robots to acquire skills autonomously, its real-world deployment is severely limited by inefficient and unsafe

OmniVL-Guard: Towards Unified Vision-Language Forgery Detection and Grounding via Balanced RL

arXiv:2602.10687v3 Announce Type: replace-cross Abstract: Existing forgery detection methods are often limited to uni-modal or bi-modal settings, failing to handle the interleaved text, images, and vi

On Kernel Eigen-alignments of KRR: Reconstruction and Generalization

arXiv:2605.15240v1 Announce Type: cross Abstract: This paper investigates the critical role of eigenalignments between the kernel matrix and learning targets in achieving robust generalization in lear

OpenFrontier: General Navigation with Visual-Language Grounded Frontiers

arXiv:2603.05377v2 Announce Type: replace-cross Abstract: Open-world navigation requires robots to make decisions in complex everyday environments while adapting to flexible task requirements. Convent

Opponent State Inference Under Partial Observability: An HMM-POMDP Framework for 2026 Formula 1 Energy Strategy

arXiv:2603.01290v3 Announce Type: replace Abstract: The 2026 Formula 1 technical regulations introduce a fundamental change to energy strategy: under a 50/50 internal combustion engine / battery power

parallelcbf: A composable safety-filter and auditability framework for tensor-parallel reinforcement learning

arXiv:2605.15509v1 Announce Type: new Abstract: While Isaac Lab provides massive parallel UAV simulation, OmniSafe and safe-control-gym provide constrained-RL benchmarks, and CBFKit provides control-b

PCASim: Promptable Closed-loop Adversarial Simulation for Urban Traffic Environment

arXiv:2605.15654v1 Announce Type: new Abstract: Real-world autonomous driving, particularly in urban environments with numerous corner cases, requires rigorous testing to ensure product safety and rob

Pessimistic Risk-Aware Policy Learning in Contextual Bandits

arXiv:2605.15620v1 Announce Type: cross Abstract: We study risk-aware offline policy learning, aiming to learn a decision rule from logged data that is optimal under general risk criteria. This proble

phi-Balancing for Mixture-of-Experts Training

arXiv:2605.15403v1 Announce Type: new Abstract: Mixture-of-Experts (MoE) models rely on balanced expert utilization to fully realize their scalability. However, existing load-balancing methods are lar

Polynomial Neural Sheaf Diffusion: A Spectral Filtering Approach on Cellular Sheaves

arXiv:2512.00242v3 Announce Type: replace-cross Abstract: Sheaf Neural Networks equip graph structures with a cellular sheaf: a geometric structure which assigns local vector spaces (stalks) and a lin

Preconditioned Regularized Wasserstein Proximal Sampling

arXiv:2509.01685v2 Announce Type: replace-cross Abstract: We consider sampling from a Gibbs distribution by evolving finitely many particles. We propose a preconditioned version of a recently proposed

Propagating Unsafe Actions in LLM Controlled Multi-Robot Collaboration via Single Robot Compromise

arXiv:2605.15641v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used as general planners in embodied intelligence, enabling high level coordination and low level task pla

PSD: Pushing the Pareto Frontier of Diffusion LLMs via Parallel Speculative Decoding

arXiv:2605.15609v1 Announce Type: new Abstract: Diffusion large language models (dLLMs) generate text by iteratively denoising masked token sequences. Although dLLMs can predict all masked positions i

Quantum Artificial Intelligence for Mission-Critical Systems: Foundations, Architectural Elements, and Future Directions

arXiv:2511.09884v2 Announce Type: replace Abstract: Mission critical (MC) applications such as defense operations, energy management, cybersecurity, and aerospace control require reliable, determinist

RanSOM: Second-Order Momentum with Randomized Scaling for Constrained and Unconstrained Optimization

arXiv:2602.06824v2 Announce Type: replace-cross Abstract: Momentum methods, such as Polyak's Heavy Ball, are the standard for training deep networks but suffer from curvature-induced bias in stochasti

RE-SAC: Disentangling aleatoric and epistemic risks in bus fleet control: A stable and robust ensemble DRL approach

arXiv:2603.18396v3 Announce Type: replace Abstract: Bus holding control is challenging due to stochastic traffic and passenger demand. While deep reinforcement learning (DRL) shows promise, standard a

Reactive Robot-Centric Safety for Autonomous Navigation in Constrained and Dynamic Environments

arXiv:2605.15782v1 Announce Type: new Abstract: In this work, we address the problem of ensuring real-time safety in autonomous robot navigation, in spatially constrained dynamic environments, by util

ReactiveGWM: Steering NPC in Reactive Game World Models

arXiv:2605.15256v1 Announce Type: new Abstract: Current game world models simulate environments from a subjective, player-centric perspective. However, by treating the Non-Player Character (NPC) merel

ReAlign: Generalizable Image Forgery Detection via Reasoning-Aligned Representation

arXiv:2605.16080v1 Announce Type: new Abstract: The rise of AI-generated images (AIGIs) poses growing challenges for digital authenticity, prompting the need for efficient, generalizable image forgery

Reference-Free Reinforcement Learning Fine-Tuning for MT: A Seq2Seq Perspective

arXiv:2605.15976v1 Announce Type: cross Abstract: Production machine translation relies overwhelmingly on encoder-decoder Seq2Seq models, yet reinforcement learning approaches to MT fine-tuning have l

Reference Games as a Testbed for the Alignment of Model Uncertainty and Clarification Requests

arXiv:2601.07820v2 Announce Type: replace Abstract: In human conversation, both interlocutors play an active role in maintaining mutual understanding. When listeners are uncertain about what speakers

Res^2CLIP: Few-Shot Generalist Anomaly Detection with Residual-to-Residual Alignment

arXiv:2605.16171v1 Announce Type: new Abstract: Few-shot Generalist Anomaly Detection requires models to generalize to novel categories without retraining, posing significant challenges in real-world

Residual Reinforcement Learning for Robot Teleoperation under Stochastic Delays

arXiv:2605.15480v1 Announce Type: cross Abstract: Stochastic communication delays in teleoperation introduce signal discontinuities that undermine control stability and degrade control performance. Co

Response-Conditioned Parallel-to-Sequential Orchestration for Multi-Agent Systems

arXiv:2605.15573v1 Announce Type: new Abstract: Multi-agent systems can solve complex tasks through collaboration between multiple Large Language Model agents. Existing collaboration frameworks typica

Reversing the Flow: Generation-to-Understanding Synergy in Large Multimodal Models

arXiv:2605.15792v1 Announce Type: new Abstract: The long-standing goal of multimodal AI is to build unified models in which visual understanding and visual generation mutually enhance one another. Des

RoPE Distinguishes Neither Positions Nor Tokens in Long Contexts, Provably

arXiv:2605.15514v1 Announce Type: cross Abstract: We identify intrinsic limitations of Rotary Positional Embeddings (RoPE) in Transformer-based long-context language models. Our theoretical analysis a

SAFE Quantum Machine Learning with Variational Quantum Classifiers

arXiv:2605.16067v1 Announce Type: new Abstract: We propose a variational quantum classifier operating on high dimensional deep representations via amplitude encoding, stabilized by a learnable classic

SafeGPT: Preventing Data Leakage and Unethical Outputs in Enterprise LLM Use

arXiv:2601.06366v2 Announce Type: replace-cross Abstract: Large Language Models (LLMs) are transforming enterprise workflows but introduce security and ethics challenges when employees inadvertently s

ScreenSearch: Uncertainty-Aware OS Exploration

arXiv:2605.16024v1 Announce Type: new Abstract: Desktop GUI agents operate under partial observability: visually similar screens can correspond to different underlying workflow states, so locally plau

Second-Order Multi-Level Variance Correction for Modality Competition in Multimodal Models

arXiv:2605.16165v1 Announce Type: cross Abstract: Autoregressive next-token training offers a unified formulation for image generation and text understanding, but it also creates strong modality compe

Seeing What Matters: Visual Preference Policy Optimization for Visual Generation

arXiv:2511.18719v4 Announce Type: replace Abstract: Reinforcement learning (RL) has become a powerful tool for post-training visual generative models, with Group Relative Policy Optimization (GRPO) in

Self-Supervised Learning by Curvature Alignment

arXiv:2511.17426v2 Announce Type: replace-cross Abstract: Self-supervised learning (SSL) has recently advanced through non-contrastive methods that couple an invariance term with variance, covariance,

Semi-MedRef: Semi-Supervised Medical Referring Image Segmentation with Cross-Modal Alignment

arXiv:2605.15720v1 Announce Type: new Abstract: Medical referring image segmentation (MRIS) requires pixel-level masks aligned with textual descriptions of anatomical locations, making annotation cost

seriou question: how do you handle an intellectual doppelganger who has systematically started adopting every position you have argued for f…

seriou question: how do you handle an intellectual doppelganger who has systematically started adopting every position you have argued for for 30 years while presenting each idea as if it were his own

Sign-Separated Finite-Time Error Analysis of Q-Learning

arXiv:2605.16103v1 Announce Type: new Abstract: This paper develops a sign-separated finite-time error analysis for constant step-size Q-learning. Starting from the switching-system representation, th

SKILL0: In-Context Agentic Reinforcement Learning for Skill Internalization

arXiv:2604.02268v2 Announce Type: replace Abstract: Agent skills, structured packages of procedural knowledge and executable resources that agents dynamically load at inference time, have become a rel

SkiP: When to Skip and When to Refine for Efficient Robot Manipulation

arXiv:2605.15536v1 Announce Type: cross Abstract: Previous imitation learning policies predict future actions at every control step, whether in smooth motion phases or precise, contact-rich operation

SLIP & ETHICS: Graduated Intervention for AI Emotional Companions

arXiv:2605.15915v1 Announce Type: cross Abstract: AI emotional companions face a safety-rapport paradox: restrictive safeguards can damage supportive alliance, while permissive systems risk user harm.

STABLE: Simulation-Ready Tabletop Layout Generation via a Semantics-Physics Dual System

arXiv:2605.16137v1 Announce Type: new Abstract: Generating simulation-ready tabletop scenes from task instructions is an intriguing and promising research direction in the field of Embodied AI. Howeve

Task-Semantic Graph-Driven Distributed Agent Networking for Underwater Target Tracking

arXiv:2605.15528v1 Announce Type: new Abstract: Autonomous underwater vehicle (AUV) swarms are emerging as intelligent underwater networks, where each node must sense, communicate, process local data,

TemplateRL: Structured Template-Guided Reinforcement Learning for LLM Reasoning

arXiv:2505.15692v5 Announce Type: replace Abstract: Reinforcement learning (RL) has emerged as an effective paradigm for enhancing model reasoning. However, existing RL methods like GRPO typically rel

Terrain Consistent Reference-Guided RL for Humanoid Navigation Autonomy

arXiv:2605.15517v1 Announce Type: new Abstract: We present a method for training reference-guided, perceptive reinforcement learning locomotion policies for humanoid robots in which reference trajecto

the AI trial of the century ended with a procedural whimper rather a bang; the jury agreed that Musk was too late but never weighed in on th…

the AI trial of the century ended with a procedural whimper rather a bang; the jury agreed that Musk was too late but never weighed in on the questions of whether OpenAI did was legitimate. and so we

The pure LLM debate - which I had for many years, here and elsewhere - is indeed no longer relevant. Why? Because I won; nobody uses pure LL…

The pure LLM debate - which I had for many years, here and elsewhere - is indeed no longer relevant. Why? Because I won; nobody uses pure LLMs anymore. Nowadays all deployed objects are neurosymbolic,

The U.S. faces a chaotic #AI regulatory patchwork with over 1,200 state bills introduced in 2025 and no unified federal framework, researche…

The U.S. faces a chaotic #AI regulatory patchwork with over 1,200 state bills introduced in 2025 and no unified federal framework, researchers @JeffSonnenfeld and Stephen Henriques of @YaleSOM and @Ga