safety

Randomized Advantage Transformation (RAT): Computing Natural Policy Gradients via Direct Backpropagation

arXiv:2605.18591v1 Announce Type: cross Abstract: Natural policy gradients improve optimization by accounting for the geometry of distribution space, but their practical use is limited by the cost of

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Safety

Ranking-Aware Calibration for Reliable Multimodal Reinforcement Learning

DGX agent

arXiv:2605.16999v1 Announce Type: new Abstract: Reinforcement learning post-training has substantially improved the reasoning accuracy of vision-language models, yet the resulting policies remain poor

safetyarxiv-cs-lg

19 May 2026

RAVE: Re-Allocating Visual Attention in Large Multimodal Models

arXiv:2605.18359v1 Announce Type: new Abstract: Large multimodal models (LMMs) inherit the self-attention mechanism of pretrained language backbones, yet standard attention can exhibit suboptimal allo

Real-Time Aligned Reward Model beyond Semantics

arXiv:2601.22664v4 Announce Type: replace Abstract: Reinforcement Learning from Human Feedback (RLHF) is a pivotal technique for aligning large language models (LLMs) with human preferences, yet it is

Real2Sim via Active Perception with Behavior Trees Automatically Generated by VLMs

arXiv:2601.08454v2 Announce Type: replace Abstract: Constructing physically accurate simulation environments (Real2Sim) traditionally relies on manual system identification or rigid, exhaustive explor

Reasoning Before Diagnosis: Physician-Inspired Structured Thinking for ECG Classification

arXiv:2605.17308v1 Announce Type: new Abstract: Electrocardiogram (ECG) diagnosis in clinical practice relies on structured reasoning over multiple hierarchical aspects, including cardiac rhythm, cond

REC-RL: Referring expression counting via Gaussian and range-based reward optimization

arXiv:2605.16460v1 Announce Type: new Abstract: Referring expression counting (REC) is an intention-driven task that requires context-aware visual reasoning. While recent vision-language models incorp

Reducing Credit Assignment Variance via Counterfactual Reasoning Paths

arXiv:2605.16302v1 Announce Type: cross Abstract: Reinforcement learning for multi-step reasoning with large language models (LLMs) often relies on sparse terminal rewards, leading to poor credit assi

Reliability and Effectiveness of Autonomous AI Agents in Supply Chain Management

arXiv:2605.17036v1 Announce Type: new Abstract: This paper studies autonomous generative AI agents in multi-echelon supply chains using the MIT Beer Game. We identify four inference-time levers that s

Remembering More, Risking More: Longitudinal Safety Risks in Memory-Equipped LLM Agents

arXiv:2605.17830v1 Announce Type: new Abstract: Safety evaluations of memory-equipped LLM agents typically measure within-task safety: whether an agent completes a single scenario safely, often under

Representational Alignment with Chemical Induced Fit for Molecular Relational Learning

arXiv:2502.07027v2 Announce Type: replace-cross Abstract: Molecular Relational Learning (MRL) is widely applied in natural sciences to predict relationships between molecular pairs by extracting struc

Resolving Representation Ambiguity in Feedforward Novel View Synthesis Transformer via Semantic-Spatial Decoupling

arXiv:2605.18599v1 Announce Type: new Abstract: Transformer-based models have advanced feedforward novel view synthesis (NVS). Current architectures such as GS-LRM and LVSM mix semantic information (e

Responsible Federated LLMs via Safety Filtering and Constitutional AI

arXiv:2502.16691v2 Announce Type: replace Abstract: Recent research has increasingly focused on training large language models (LLMs) using federated learning, known as FedLLM. However, responsible AI

Rethinking Code Review in the Age of AI: A Vision for Agentic Code Review

arXiv:2605.17548v1 Announce Type: cross Abstract: Code review has evolved for decades, from informal peer checking to today's pull request (PR) workflows, yet it remains a largely manual, uneven, and

Retrieval and competition: how a protein foundation model starts a protein

arXiv:2605.16331v1 Announce Type: cross Abstract: Protein language models are increasingly used to guide experimental and clinical decisions, yet it is often unclear whether a confident prediction ref

Right Predictions, Misleading Explanations: On the Vulnerability of Vision-Language Model Explanations

arXiv:2605.16651v1 Announce Type: new Abstract: Explanation mechanisms are increasingly used to support transparency and trust in vision-language models (VLMs), particularly in settings where model de

RL4RLA: Teaching ML to Discover Randomized Linear Algebra Algorithms Through Curriculum Design and Graph-Based Search

arXiv:2605.18004v1 Announce Type: new Abstract: Randomized linear algebra (RLA) algorithms are a modern class of numerical linear algebra techniques that play an essential role in scientific computing

Running the same CNA search on base models (before instruction tuning) yields a structurally similar set of neurons, but ablating them produ…

Running the same CNA search on base models (before instruction tuning) yields a structurally similar set of neurons, but ablating them produces almost no behavioral change. We read this as evidence th

safetynous-research--x

S2Aligner: Pair-Efficient and Transferable Pre-Training for Sparse Text-Attributed Graphs

arXiv:2605.18579v1 Announce Type: new Abstract: Pre-training on text-attributed graphs (TAGs) is central to building transferable graph foundation models, where LLM-as-Aligner methods align graph and

SADP: Subgoal-Aware Diffusion Policy for Explainable Robots Learned from Foundation Model Generated Demonstrations

arXiv:2605.16871v1 Announce Type: new Abstract: Explainable robots require not only successful task execution but also the ability to expose internal decision-making process in a user-friendly manner.

SafeDiffusion-R1: Online Reward Steering for Safe Diffusion Post-Training

arXiv:2605.18719v1 Announce Type: new Abstract: Diffusion models have been widely studied for removing unsafe content learned during pre-training. Existing methods require expensive supervised data, e

Safety Geometry Collapse in Multimodal LLMs and Adaptive Drift Correction

arXiv:2605.18104v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) often fail to transfer safety capabilities learned in the text modality to semantically equivalent non-text inp

SAPO: Step-Aligned Policy Optimization for Reasoning-Based Generative Recommendation

arXiv:2605.17648v1 Announce Type: new Abstract: Generative recommendation treats next-item prediction as autoregressive item-identifier generation. Specifically, items are encoded as semantic identifi

Scalable Bi-causal Optimal Transport via KL Relaxation and Policy Gradients

arXiv:2605.17271v1 Announce Type: cross Abstract: Bi-causal optimal transport (OT) is a natural framework for comparing and coupling stochastic processes under nonanticipative information constraints,

Scale Determines Whether Language Models Organize Representation Geometry for Prediction

arXiv:2605.17084v1 Announce Type: cross Abstract: In language models, what a representation encodes is determined by the geometry of its representation space: distances, not activations, carry meaning

Scenario Generation in Roundabouts with Adjustable Interaction Intensity

arXiv:2605.18026v1 Announce Type: new Abstract: Roundabouts, characterized by frequent merging and yielding interactions, remain a safety-critical corner case for the development and testing of intell

SD-Search: On-Policy Hindsight Self-Distillation for Search-Augmented Reasoning

arXiv:2605.18299v1 Announce Type: new Abstract: Search-augmented reasoning agents interleave internal reasoning with calls to an external retriever, and their performance relies on the quality of each

Self-Evolving Spatial Reasoning in Vision Language Models via Geometric Logic Consistency

arXiv:2605.18162v1 Announce Type: cross Abstract: Vision-Language Models (VLMs) have made striking progress, yet their spatial reasoning remains fragile: models that answer an original input correctly

Semantic Smoothing via Novel View Synthesis for Robust SAR Image Classification

arXiv:2605.16440v1 Announce Type: cross Abstract: Deep neural networks are vulnerable to adversarial perturbations, limiting deployment in safety-critical applications such as synthetic aperture radar

SG-CADVLM: A Context-Aware Decoding Powered Vision Language Model for Safety-Critical Scenario Generation

arXiv:2601.18442v3 Announce Type: replace Abstract: Autonomous Vehicle (AV) requires rigorous testing in safety-critical scenarios for safety validation, yet its validation is hindered by the high cos

SGSoft: Learning Fused Semantic-Geometric Features for 3D Shape Correspondence via Template-Guided Soft Signals

arXiv:2605.18039v1 Announce Type: new Abstract: Learning dense correspondences across deformable 3D shapes remains a long-standing challenge due to structural variability, non-isometric deformation, a

Shared Backbone PPO for Multi-UAV Communication Coverage with Connection Preservation

arXiv:2605.17999v1 Announce Type: new Abstract: This paper proposes a Shared Backbone Proximal Policy Optimization (Shared Backbone PPO) algorithm. By sharing the base module between the Actor and Cri

SHED: Style-Homogenized Embedding Alignment for Domain Generalization

arXiv:2605.16973v1 Announce Type: new Abstract: Domain generalization aims to enhance model robustness against unseen domains with embedding distribution shifts. While large-scale vision-language mode

show me your /goal prompt that beats this (i'll share mine below so as not to bias)

This post appears to be a community prompt-sharing discussion where Swyx invites people to share their '/goal' prompts (likely system prompts or directives designed to optimize AI behavior toward spec

safetyswyx--x

Simple Approximation and Derivative Free Inference-Time Scaling for Diffusion Models via Sequential Monte Carlo on Path Measures

arXiv:2605.17850v1 Announce Type: cross Abstract: iffusion-based generative models increasingly rely on inference-time guidance, adding a drift term or reweighting mixture of experts, to improve sampl

Single-Sample Black-Box Membership Inference Attack against Vision-Language Models via Cross-modal Semantic Alignment

arXiv:2605.17341v1 Announce Type: cross Abstract: Vision-Language Models (VLMs) have achieved remarkable success, yet their reliance on massive datasets and unintended memorization of training data ra

SNLP: Layer-Parallel Inference via Structured Newton Corrections

arXiv:2605.17842v1 Announce Type: new Abstract: Autoregressive language models execute Transformer layers sequentially, creating a latency bottleneck that is not removed by conventional tensor or pipe

Soap2Soap: Long Cinematic Video Remaking via Multi-Agent Collaboration

arXiv:2605.17423v1 Announce Type: new Abstract: We study series-level cinematic remaking, a long-horizon video-to-video generation problem that localizes full episodes or films via stylization or acto

Speak Your Mind: The Speech Continuation Task as a Probe of Voice-Based Model Bias

arXiv:2509.22061v2 Announce Type: replace-cross Abstract: Speech Continuation (SC) is the task of generating a coherent extension of a spoken prompt while preserving both semantic context and speaker

SSL4RL: Revisiting Self-supervised Learning as Intrinsic Reward for Visual-Language Reasoning

arXiv:2510.16416v4 Announce Type: replace-cross Abstract: Vision-language models (VLMs) have shown remarkable abilities by integrating large language models with visual inputs. However, they often fai

Stable and Near-Reversible Diffusion ODE Solvers for Image Editing

arXiv:2605.16399v1 Announce Type: new Abstract: The inversion of diffusion models plays a central role in image editing. Algebraically reversible ODE solvers provide an appealing approach to diffusion

Stable Routing for Mixture-of-Experts in Class-Incremental Learning

arXiv:2605.17571v1 Announce Type: new Abstract: Class-incremental learning (CIL) requires models to learn new classes sequentially while preserving prior knowledge. Recently, approaches that combine p

StableHand: Quality-Aware Flow Matching for World-Space Dual-Hand Motion Estimation from Egocentric Video

arXiv:2605.18553v1 Announce Type: cross Abstract: Recovering world space 4D motion of two interacting hands from egocentric video is a fundamental capability for supervising robot policy learning, whe

State-Conditional Adversarial Learning: An Off-Policy Visual Domain Transfer Method for End-to-End Imitation Learning

arXiv:2512.05335v3 Announce Type: replace Abstract: We study visual domain transfer for end-to-end imitation learning in a realistic and challenging setting where target-domain data are strictly off-p

State Contamination in Memory-Augmented LLM Agents

arXiv:2605.16746v1 Announce Type: new Abstract: LLM agents increasingly rely on persistent state, including transcripts, summaries, retrieved context, and memory buffers, to support long-horizon inter

Stochastic Penalty-Barrier Methods for Constrained Machine Learning

arXiv:2605.18618v1 Announce Type: cross Abstract: Constrained machine learning enables fairness-aware training, physics-informed neural networks, and integration of symbolic domain knowledge into stat

Stop When Reasoning Converges: Semantic-Preserving Early Exit for Reasoning Models

arXiv:2605.17672v1 Announce Type: new Abstract: Large Reasoning Models (LRMs) achieve strong performance by generating long chains of thought (CoT), but often overthink, continuing to reason after a s

Structure-Aware Masking for Protein Representation Learning

arXiv:2605.16581v1 Announce Type: new Abstract: Masked language modeling (MLM) is the standard objective for training protein language models, typically implemented by randomly masking individual resi