Search: “safety”

GRACE: Gradient-aligned Reasoning Data Curation for Efficient Post-training

arXiv:2605.13130v1 Announce Type: new Abstract: Existing reasoning data curation pipelines score whole samples, treating every intermediate step as equally valuable. In reality, steps within a trace c

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Graph-Based Financial Fraud Detection with Calibrated Risk Scoring and Structural Regularization

DGX agent

arXiv:2605.12782v1 Announce Type: new Abstract: Financial transaction fraud prevention faces challenges such as complex relationship structures, concealed behavioral patterns, and dynamically changing

safetyarxiv-cs-lg

14 May 2026

Helping ChatGPT better recognize context in sensitive conversations

OpenAI implemented improvements to help ChatGPT better understand and respond appropriately to context in sensitive conversations, such as those involving mental health, abuse, or other delicate topic

safetyopenai

HIR-ALIGN: Enhancing Hyperspectral Image Restoration via Diffusion-Based Data Generation

arXiv:2605.13581v1 Announce Type: new Abstract: Hyperspectral image (HSI) restoration is crucial for reliable analysis, as real HSIs suffer from degradations like noise, blur, and resolution loss. How

Improving Classifier-Free Guidance of Flow Matching via Manifold Projection

arXiv:2601.21892v2 Announce Type: replace-cross Abstract: Classifier-free guidance (CFG) is a widely used technique for controllable generation in diffusion and flow-based models. Despite its empirica

Improving Code Translation with Syntax-Guided and Semantic-aware Preference Optimization

arXiv:2605.13229v1 Announce Type: new Abstract: LLMs have shown immense potential for code translation, yet they often struggle to ensure both syntactic correctness and semantic consistency. While pre

Improving Diffusion Posterior Samplers with Lagged Temporal Corrections for Image Restoration

arXiv:2605.12573v1 Announce Type: cross Abstract: Diffusion-based posterior sampling (PS) is a leading framework for imaging inverse problems, combining learned priors with measurement constraints. Ye

In a policy paper, Anthropic urges the US and allies to enforce export controls, curb distillation attacks, and export US AI to hold the lead over China by 2028 (Anthropic)

Anthropic: In a policy paper, Anthropic urges the US and allies to enforce export controls, curb distillation attacks, and export US AI to hold the lead over China by 2028 — We're releasing a new pape

safetytechmeme

In-Situ Behavioral Evaluation for LLM Fairness, Not Standardized-Test Scores

arXiv:2605.12530v1 Announce Type: cross Abstract: LLM fairness should be evaluated through in-situ conversational behavior rather than standardized-test Q&A benchmarks. We show that the standardized-t

In the @nytimes, Media Lab Prof. @kesvelt and other scientists call for stronger oversight and regulation of AI technologies, including chat…

In the @nytimes, Media Lab Prof. @kesvelt and other scientists call for stronger oversight and regulation of AI technologies, including chatbots that can provide information on producing lethal biolog

safetygary-marcus--x

interwhen: A Generalizable Framework for Steering Reasoning Models with Test-time Verification

arXiv:2602.11202v3 Announce Type: replace-cross Abstract: Reasoning models produce long traces of intermediate decisions and tool calls, making test-time verification important for ensuring correctnes

Is Video Anomaly Detection Misframed? Evidence from LLM-Based and Multi-Scene Models

arXiv:2605.12725v1 Announce Type: new Abstract: Recent video anomaly detection research has expanded rapidly with an emphasis on general models of normality intended to work across many different scen

Model Releases

Learning Responsibility-Attributed Adversarial Scenarios for Testing Autonomous Vehicles

model-releasesarxiv-cs-ro

arXiv:2605.13751v1 Announce Type: new Abstract: Establishing trustworthy safety assurance for autonomous driving systems (ADSs) requires evidence that failures arise from avoidable system deficiencies

Learning to Decide with AI Assistance under Human-Alignment

arXiv:2605.12646v1 Announce Type: cross Abstract: It is widely agreed that when AI models assist decision-makers in high-stakes domains by predicting an outcome of interest, they should communicate th

Learning Transferable Latent User Preferences for Human-Aligned Decision Making

arXiv:2605.12682v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used as reasoning modules in many applications. While they are efficient in certain tasks, LLMs often stru

Learning with Rare Success but Rich Feedback via Reflection-Enhanced Self-Distillation

arXiv:2605.12741v1 Announce Type: new Abstract: Enabling Large Language Models (LLMs) to continuously improve from environmental interactions is a central challenge in post-training. While on-policy s

Macro-Action Based Multi-Agent Instruction Following through Value Cancellation

arXiv:2605.12655v1 Announce Type: new Abstract: Multi-agent reinforcement learning (MARL) in real-world use cases may need to adapt to external natural language instructions that interrupt ongoing beh

MaskPro: Linear-Space Probabilistic Learning for Strict (N:M)-Sparsity on LLMs

arXiv:2506.12876v2 Announce Type: replace Abstract: The rapid scaling of large language models~(LLMs) has made inference efficiency a primary bottleneck in the practical deployment. To address this, s

MinT: Managed Infrastructure for Training and Serving Millions of LLMs

arXiv:2605.13779v1 Announce Type: cross Abstract: We present MindLab Toolkit (MinT), a managed infrastructure system for Low-Rank Adaptation (LoRA) post-training and online serving. MinT targets a set

MUJICA: Multi-skill Unified Joint Integration of Control Architecture for Wheeled-Legged Robots

arXiv:2605.13058v1 Announce Type: new Abstract: Wheeled-legged robots hold promise for traversing complex terrains and offer superior mobility compared to legged robots. However, wheeled-legged robots

safetyarxiv-cs-ro

Multi-Objective and Mixed-Reward Reinforcement Learning via Reward-Decorrelated Policy Optimization

arXiv:2605.13641v1 Announce Type: new Abstract: Complex reinforcement learning environments frequently employ multi-task and mixed-reward formulations. In these settings, heterogeneous reward distribu

Multi-Rollout On-Policy Distillation via Peer Successes and Failures

arXiv:2605.12652v1 Announce Type: cross Abstract: Large language models are often post-trained with sparse verifier rewards, which indicate whether a sampled trajectory succeeds but provide limited gu

Not Just RLHF: Why Alignment Alone Won't Fix Multi-Agent Sycophancy

arXiv:2605.12991v1 Announce Type: cross Abstract: LLM-based multi-agent pipelines flip from correct to incorrect answers under simulated peer disagreement at rates we term yield, a vulnerability widel

ODRPO: Ordinal Decompositions of Discrete Rewards for Robust Policy Optimization

arXiv:2605.12667v1 Announce Type: cross Abstract: The alignment of Large Language Models (LLMs) utilizes Reinforcement Learning from AI Feedback (RLAIF) for non-verifiable domains such as long-form qu

On the Generalization of Knowledge Distillation: An Information-Theoretic View

arXiv:2605.13143v1 Announce Type: cross Abstract: Knowledge distillation is widely used to improve generalization in practice, yet its theoretical understanding remains elusive. In the standard distil

On the Sample Complexity of Differentially Private Policy Optimization

arXiv:2510.21060v3 Announce Type: replace-cross Abstract: Policy optimization (PO) is a cornerstone of modern reinforcement learning (RL), with diverse applications spanning robotics, healthcare, and

Oof. One of the few things Americans of all parties appear to agree on.

This post likely discusses a topic of broad bipartisan agreement among Americans, with Gary Marcus commenting on its significance on social media. The specific topic of agreement is not determinable f

safetygary-marcus--x

OptMap: Geometric Map Distillation via Submodular Maximization

arXiv:2512.07775v2 Announce Type: replace Abstract: Autonomous robots rely on geometric maps to inform a diverse set of perception and decision-making algorithms. As autonomy requires reasoning and pl

safetyarxiv-cs-ro

Pareto-Guided Optimal Transport for Multi-Reward Alignment

arXiv:2605.13155v1 Announce Type: new Abstract: Text-to-image generation models have achieved remarkable progress in preference optimization, yet achieving robust alignment across diverse reward model

PG-LRF: Physiology-Guided Latent Rectified Flow for Electro-Hemodynamic PPG-to-ECG Generation

arXiv:2605.12541v1 Announce Type: cross Abstract: Electrocardiography (ECG) is the clinical standard for cardiac assessment but requires dedicated hardware that does not scale to daily-life monitoring

Position: Assistive Agents Need Accessibility Alignment

arXiv:2605.13579v1 Announce Type: new Abstract: Assistive agents for Blind and Visually Impaired (BVI) users require accessibility alignment as a first-class design objective. Despite rapid progress i

PRA-PoE: Robust Alzheimer's Diagnosis with Arbitrary Missing Modalities

arXiv:2605.13081v1 Announce Type: new Abstract: Missing modalities are prevalent in real-world Alzheimer's disease (AD) assessment and pose a significant challenge to multimodal learning, particularly

Precautionary Governance of Autonomous AI: Legal Personhood as Functional Instrument

arXiv:2605.12505v1 Announce Type: cross Abstract: Autonomous AI systems generate responsibility gaps: consequential actions that cannot be satisfactorily attributed to developers, operators, or users

Pretraining Language Models with Subword Regularization: An Empirical Study of BPE Dropout in Low-Resource NLP

arXiv:2605.13436v1 Announce Type: cross Abstract: Subword regularization methods such as BPE dropout are typically applied only during fine-tuning, while pretraining is usually done with deterministic

Protocol-Driven Development: Governing Generated Software Through Invariants and Evidence

arXiv:2605.12981v1 Announce Type: cross Abstract: Automated program synthesis has reduced the cost of producing candidate implementations, but it introduces a harder governance problem: determining wh

Provably avoiding over-optimization in Direct Preference Optimization without knowing the data distribution

arXiv:2602.06239v2 Announce Type: replace Abstract: We introduce PEPO (Pessimistic Ensemble based Preference Optimization), a single-step Direct Preference Optimization (DPO)-like algorithm to mitigat

Proximal-Based Generative Modeling for Bayesian Inverse Problems

arXiv:2605.13278v1 Announce Type: cross Abstract: Score-based diffusion models demonstrate superior performance in generative tasks but encounter fundamental bottlenecks in inverse problems due to the

Pyramid Forcing: Head-Aware Pyramid KV Cache Policy for High-Quality Long Video Generation

arXiv:2605.13111v1 Announce Type: new Abstract: Autoregressive video generation enables streaming and open-ended long video synthesis, but still suffers from long-term degradation caused by accumulate

Q-Flow: Stable and Expressive Reinforcement Learning with Flow-Based Policy

arXiv:2605.13435v1 Announce Type: cross Abstract: There is growing interest in utilizing flow-based models as decision-making policies in reinforcement learning due to their high expressive capacity.

R-DMesh: Video-Guided 3D Animation via Rectified Dynamic Mesh Flow

arXiv:2605.13838v1 Announce Type: new Abstract: Video-guided 3D animation holds immense potential for content creation, offering intuitive and precise control over dynamic assets. However, practical d

RAG-GNN: Integrating Retrieved Knowledge with Graph Neural Networks for Precision Medicine

arXiv:2602.00586v2 Announce Type: replace-cross Abstract: Network topology excels at structural predictions but fails to capture functional semantics encoded in biomedical literature. We present RAG-G

Real2Sim: A Physics-driven and Editable Gaussian Splatting Framework for Autonomous Driving Scenes

arXiv:2605.13591v1 Announce Type: new Abstract: Reliable autonomous driving relies on large-scale, well-labeled data and robust models. However, manual data collection is resource-intensive, and tradi

Respecting Self-Uncertainty in On-Policy Self-Distillation for Efficient LLM Reasoning

arXiv:2605.13255v1 Announce Type: new Abstract: On-policy self-distillation trains a reasoning model on its own rollouts while a teacher, often the same model conditioned on privileged context, provid

Revealing the Gap in Human and VLM Scene Perception through Counterfactual Semantic Saliency

arXiv:2605.13047v1 Announce Type: cross Abstract: Evaluating whether large vision-language models (VLMs) align with human perception for high-level semantic scene comprehension remains a challenge. Tr

Revisiting DAgger in the Era of LLM-Agents

arXiv:2605.12913v1 Announce Type: new Abstract: Long-horizon LM agents learn from multi-turn interaction, where a single early mistake can alter the subsequent state distribution and derail the whole

Reward-Weighted On-Policy Distillation with an Open Property-Equivalence Verifier for NL-to-SVA Generation

arXiv:2605.13501v1 Announce Type: cross Abstract: LLM-based generation of SystemVerilog Assertions (SVA) is often reported as nearing saturation, with the strongest specialized model reaching {sim}76%

RoboEvolve: Co-Evolving Planner-Simulator for Robotic Manipulation with Limited Data

arXiv:2605.13775v1 Announce Type: cross Abstract: The scalability of robotic manipulation is fundamentally bottlenecked by the scarcity of task-aligned physical interaction data. While vision-language

Robot Squid Game: Quadrupedal Locomotion for Traversing Narrow Tunnels

arXiv:2605.13665v1 Announce Type: new Abstract: Quadruped robots demonstrate exceptional potential for navigating complex terrain in critical applications such as search and rescue missions and infras

safetyarxiv-cs-ro