Search: “safety”

Temper and Tilt Lead to SLOP: Reward Hacking Mitigation with Inference-Time Alignment

arXiv:2605.13537v1 Announce Type: cross Abstract: Inference-time alignment techniques offer a lightweight alternative or complement to costly reinforcement learning, while enabling continual adaptatio

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Safety

Test-time Offline Reinforcement Learning on Goal-related Experience

DGX agent

arXiv:2507.18809v2 Announce Type: replace Abstract: Foundation models compress a large amount of information in a single, large neural network, which can then be queried for individual tasks. There ar

safetyarxiv-cs-lg

14 May 2026

Test-time Sparsity for Extreme Fast Action Diffusion

arXiv:2605.13316v1 Announce Type: new Abstract: Action diffusion excels at high-fidelity action generation but incurs heavy computational costs owing to its iterative denoising nature. Despite current

The End Justifies the Mean: A Linear Ranking Rule for Proportional Sequential Decisions

arXiv:2605.12717v1 Announce Type: cross Abstract: AI alignment and participatory design motivate a new democratic design problem: how to collectively choose a decision rule to use repeatedly. We study

The Horizon Threshold in Cooperative Multi-Agent Reward-Free Exploration

arXiv:2602.01453v3 Announce Type: replace Abstract: We study cooperative multi-agent reinforcement learning in the setting of reward-free exploration, where multiple agents jointly explore an unknown

Think Twice, Act Once: Verifier-Guided Action Selection For Embodied Agents

arXiv:2605.12620v1 Announce Type: new Abstract: Building generalist embodied agents capable of solving complex real-world tasks remains a fundamental challenge in AI. Multimodal Large Language Models

Tight Sample Complexity Bounds for Entropic Best Policy Identification

arXiv:2605.13717v1 Announce Type: new Abstract: We study best-policy identification for finite-horizon risk-sensitive reinforcement learning under the entropic risk measure. Recent work established a

Topology-Preserving Neural Operator Learning via Hodge Decomposition

arXiv:2605.13834v1 Announce Type: cross Abstract: In this paper, we study solution operators of physical field equations on geometric meshes from a function-space perspective. We reveal that Hodge ort

Towards a holistic understanding of Selection Bias for Causal Effect Identification

arXiv:2605.13430v1 Announce Type: cross Abstract: Selection bias is pervasive in observational studies. For example, large scale biobanks data can exhibit ``healthy volunteer bias'' when respondents a

Towards Generalizable Reasoning: Group Causal Counterfactual Policy Optimization for LLM Reasoning

arXiv:2602.06475v2 Announce Type: replace Abstract: Large language models (LLMs) excel at complex tasks with advances in reasoning capabilities. However, existing reward mechanisms remain tightly coup

TrackCraft3R: Repurposing Video Diffusion Transformers for Dense 3D Tracking

arXiv:2605.12587v1 Announce Type: new Abstract: Dense 3D tracking from monocular video is fundamental to dynamic scene understanding. While recent 3D foundation models provide reliable per-frame geome

Trajectory-Level Data Augmentation for Offline Reinforcement Learning

arXiv:2605.13401v1 Announce Type: new Abstract: We propose a data augmentation method for offline reinforcement learning, motivated by active positioning problems. Particularly, our approach enables t

Uncertainty-aware Spatial-Frequency Registration and Fusion for Infrared and Visible Images

arXiv:2605.13049v1 Announce Type: new Abstract: Infrared and Visible Image Fusion (IVIF) has shown promise in visual tasks under challenging environments, but fusion under unregistered conditions face

Unifying Entropy Regularization in Optimal Control: From and Back to Classical Objectives via Iterated Soft Policies and Path Integral Solutions

arXiv:2512.06109v3 Announce Type: replace-cross Abstract: This paper develops a unified perspective on several optimal control formulations through the lens of Kullback-Leibler (KL) regularization. We

UniJEPA: Enhancing Robot Policy via Unified Continuous and Discrete Representation Learning

arXiv:2510.10642v3 Announce Type: replace-cross Abstract: Building generalist robot policies that can handle diverse tasks in open-ended environments is a central challenge in robotics. To leverage kn

Unweighted ranking for value-based decision making with uncertainty

arXiv:2605.13601v1 Announce Type: new Abstract: As intelligent systems are increasingly implemented in our society to make autonomous decisions, their commitment to human values raises serious concern

VideoSEAL: Mitigating Evidence Misalignment in Agentic Long Video Understanding by Decoupling Answer Authority

arXiv:2605.12571v1 Announce Type: cross Abstract: Long video question answering requires locating sparse, time-scattered visual evidence within highly redundant content. Although current MLLMs perform

WD-FQDet: Multispectral Detection Transformer via Wavelet Decomposition and Frequency-aware Query Learning

arXiv:2605.13621v1 Announce Type: new Abstract: Infrared-visible object detection improves detection performance by combining complementary features from multispectral images. Existing backbone-specif

What properties of reasoning supervision are associated with improved downstream model quality?

arXiv:2605.13290v1 Announce Type: new Abstract: Validating training data for reasoning models typically requires expensive trial-and-error fine-tuning cycles. In this work, we investigate whether the

What to Ignore, What to React: Visually Robust RL Fine-Tuning of VLA Models

arXiv:2605.13105v1 Announce Type: new Abstract: Reinforcement learning (RL) fine-tuning has shown promise for Vision-Language-Action (VLA) models in robotic manipulation, but deployment-time visual sh

safetyarxiv-cs-ro

When Backdoors Meet Partial Observability: Attacking Real-World Reinforcement Learning

arXiv:2601.14104v2 Announce Type: replace-cross Abstract: Backdoor attacks can cause reinforcement learning (RL) policies to behave normally under clean inputs while executing malicious behaviors when

When to Act, Ask, or Learn: Uncertainty-Aware Policy Steering

arXiv:2602.22474v2 Announce Type: replace-cross Abstract: Policy steering is an emerging way to adapt robot behaviors at deployment-time: a learned verifier analyzes low-level action samples proposed

When to Trust Confidence Thresholding: Calibration Diagnostics for Pseudo-Labelled Regression

arXiv:2605.12780v1 Announce Type: cross Abstract: Calibrated probability outputs of trained classifiers are increasingly used as inputs to downstream regression estimands such as effects, prevalences,

A Survey of On-Policy Distillation for Large Language Models

arXiv:2604.00626v2 Announce Type: replace-cross Abstract: As Large Language Models (LLMs) continue to grow in both capability and cost, transferring frontier capabilities into smaller, deployable stud

A Theory of Time-Sensitive Language Generation: Sparse Hallucination Beats Mode Collapse

arXiv:2605.11302v1 Announce Type: cross Abstract: We study language generation in the limit under a global preference ordering on strings, as introduced by Kleinberg and Wei. As in [arXiv:2504.14370,

A Unified Graph Language Model for Multi-Domain Multi-Task Graph Alignment Instruction Tuning

arXiv:2605.12197v1 Announce Type: new Abstract: Leveraging Graph Neural Networks (GNNs) as graph encoders and aligning the resulting representations with Large Language Models (LLMs) through alignment

ACSAC: Adaptive Chunk Size Actor-Critic with Causal Transformer Q-Network

arXiv:2605.11009v1 Announce Type: new Abstract: Long-horizon, sparse-reward tasks pose a fundamental challenge for reinforcement learning, since single-step TD learning suffers from bootstrapping erro

Adaptive Policy Learning Under Unknown Network Interference

arXiv:2605.11191v1 Announce Type: cross Abstract: Adaptive experimentation under unknown network interference requires solving two coupled problems: (i) learning the underlying dynamics of interferenc

Adaptive TD-Lambda for Cooperative Multi-agent Reinforcement Learning

arXiv:2605.11880v1 Announce Type: new Abstract: TD(lambda) in value-based MARL algorithms or the Temporal Difference critic learning in Actor-Critic-based (AC-based) algorithms synergistically integra

Adaptive Teacher Exposure for Self-Distillation in LLM Reasoning

arXiv:2605.11458v1 Announce Type: cross Abstract: On-policy self-distillation has become a strong recipe for LLM reasoning, where a privileged teacher supervises the student's own rollouts while condi

AIA: Rethinking Architecture Decoupling Strategy In Unified Multimodal Model

arXiv:2511.22663v5 Announce Type: replace Abstract: Unified multimodal models for image generation and understanding represent a significant step toward AGI and have attracted widespread attention fro

Aligning Flow Map Policies with Optimal Q-Guidance

arXiv:2605.12416v1 Announce Type: new Abstract: Generative policies based on expressive model classes, such as diffusion and flow matching, are well-suited to complex control problems with highly mult

AlphaGRPO: Unlocking Self-Reflective Multimodal Generation in UMMs via Decompositional Verifiable Reward

arXiv:2605.12495v1 Announce Type: new Abstract: In this paper, we propose AlphaGRPO, a novel framework that applies Group Relative Policy Optimization (GRPO) to AR-Diffusion Unified Multimodal Models

Anti-Self-Distillation for Reasoning RL via Pointwise Mutual Information

arXiv:2605.11609v1 Announce Type: cross Abstract: On-policy self-distillation, where a student is pulled toward a copy of itself conditioned on privileged context (e.g., a verified solution or feedbac

Assessment of cloud and associated radiation fields from a GAN stochastic cloud subcolumn generator

arXiv:2605.11968v1 Announce Type: cross Abstract: Modern Earth System Models (ESMs) operate on horizontal scales far larger than typical cloud features, requiring stochastic subcolumn generators to re

Asymmetric Advantage Modulation Calibrates Entropy Dynamics in RLVR

arXiv:2604.04894v2 Announce Type: replace Abstract: Reinforcement learning with verifiable rewards (RLVR) has substantially improved the reasoning ability of large language models (LLMs), but it often

Augmented Lagrangian Method for Last-Iterate Convergence for Constrained MDPs

arXiv:2605.11694v1 Announce Type: new Abstract: We study policy optimization for infinite-horizon, discounted constrained Markov decision processes (CMDPs). While existing theoretical guarantees typic

Autoregressive Learning in Joint KL: Sharp Oracle Bounds and Lower Bounds

arXiv:2605.12316v1 Announce Type: new Abstract: We study the fundamental and timely problem of learning long sequences in autoregressive modeling and next-token prediction under model misspecification

Beyond Point-wise Neural Collapse: A Topology-Aware Hierarchical Classifier for Class-Incremental Learning

arXiv:2605.11904v1 Announce Type: new Abstract: The Nearest Class Mean (NCM) classifier is widely favored in Class-Incremental Learning (CIL) for its superior resistance to catastrophic forgetting com

Can Graphs Help Vision SSMs See Better?

arXiv:2605.11300v1 Announce Type: new Abstract: Vision state space models inherit the efficiency and long-range modeling ability of Mamba-style selective scans. However, their performance depends crit

Causal Bias Detection in Generative Artifical Intelligence

arXiv:2605.11365v1 Announce Type: cross Abstract: Automated systems built on artificial intelligence (AI) are increasingly deployed across high-stakes domains, raising critical concerns about fairness

Causal Fairness for Survival Analysis

arXiv:2605.11362v1 Announce Type: new Abstract: In the data-driven era, large-scale datasets are routinely collected and analyzed using machine learning (ML) and artificial intelligence (AI) to inform

CheXTemporal: A Dataset for Temporally-Grounded Reasoning in Chest Radiography

arXiv:2605.11304v1 Announce Type: new Abstract: Chest radiograph interpretation requires temporal reasoning over prior and current studies, yet most vision-language models are trained on static image-

Clarity: The Flexibility-Interpretability Trade-Off in Sparsity-aware Concept Bottleneck Models

arXiv:2601.21944v2 Announce Type: replace Abstract: The widespread adoption of deep learning models in computer vision has intensified concerns about interpretability. Despite strong performance, thes

Cluster-Aware Neural Collapse Prompt Tuning for Long-Tailed Generalization of Vision-Language Models

arXiv:2605.11939v1 Announce Type: new Abstract: Prompt learning has emerged as an efficient alternative to fine-tuning pre-trained vision-language models (VLMs). Despite its promise, current methods s

Combining On-Policy Optimization and Distillation for Long-Context Reasoning in Large Language Models

arXiv:2605.12227v1 Announce Type: new Abstract: Adapting large language models (LLMs) to long-context tasks requires post-training methods that remain accurate and coherent over thousands of tokens. E

Controllable User Simulation

arXiv:2605.11519v1 Announce Type: cross Abstract: Using offline datasets to evaluate conversational agents often fails to cover rare scenarios or to support testing new policies. This has motivated th

Coordinated Diffusion: Generating Multi-Agent Behavior Without Multi-Agent Demonstrations

arXiv:2605.11485v1 Announce Type: new Abstract: Imitation learning powered by generative models has proven effective for modeling complex single-agent behaviors. However, teaching multi-agent systems,

safetyarxiv-cs-ro