Search: “safety”

RubiCap: Rubric-Guided Reinforcement Learning for Dense Image Captioning

arXiv:2603.09160v2 Announce Type: replace Abstract: Dense image captioning is critical for vision-language pretraining and for text-to-image generation, but scaling expert-quality annotations is prohi

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Sample What You Say: Aligning Language Models to Sample the Distributions They State

DGX agent

arXiv:2609.34929v1 Announce Type: new Abstract: Language models are increasingly used to sample from a specified distribution, for instance, to simulate survey respondents or generate synthetic data.

safetyarxiv-cs-lg

29 Sept 2026

Save Your Saturated Data: Learning Beyond Reward Saturation in Group-Based RL

arXiv:2609.33126v1 Announce Type: new Abstract: Group-relative reinforcement learning (RL) relies on reward variation among sampled responses to estimate informative relative advantages. As language m

Scaffold Then Internalize: Representation Injection for Diffusion Transformers

arXiv:2609.35292v1 Announce Type: new Abstract: Recent representation alignment (REPA) methods accelerate diffusion transformer training by aligning projections of the transformer's hidden states with

Scalable Attribution and Control of Model Behavior During Training

arXiv:2609.33667v1 Announce Type: new Abstract: Attributing and controlling model behavior during training requires identifying each example's contribution quickly enough to act before the next update

Schrodinger--Follmer Actor--Critic: Diffusion Policy Improvement with Finite-Sample Analysis

arXiv:2609.33239v1 Announce Type: cross Abstract: Diffusion policies represent multimodal action distributions, but an advantage-weighted update does not specify how to sample from the resulting targe

SCOPD: Sparse-Context On-Policy Self-Distillation for Efficient Vision-Language Models

arXiv:2609.34044v1 Announce Type: new Abstract: Reasoning vision-language models (VLMs) process images and videos as long sequences of visual tokens, making inference expensive. Training-free token pr

SEES: A Self-Evolving Embodied System via Failure-Guided VLA Policy Adaptation

arXiv:2609.32698v1 Announce Type: new Abstract: Recent vision-language-action (VLA) policies demonstrate promising generalization across diverse short-horizon tasks. However, they remain unreliable on

Self-Confirming Superposition Traps in Reinforcement Learning

arXiv:2609.32966v1 Announce Type: new Abstract: Reinforcement learning (RL) trains representations on data selected by the agent's policy, which then uses the resulting returns to guide its next choic

Self-Evolving Coding Agents: From Digital Programs to Physical-World Intelligence

arXiv:2609.35432v1 Announce Type: new Abstract: Vision-language-action (VLA) and world-action (WAM) models map observations and instructions directly to robot actions. This directness ties a policy to

Semantic Modality Compensation for Unsupervised Visible-Infrared Person Re-identification under Unpaired Settings

arXiv:2609.34294v1 Announce Type: new Abstract: Unsupervised visible-infrared person re-identification (USL-VI-ReID) learns person representations that can be compared across modalities without identi

SemReward-VL: Semantic Reward-Guided Video-Language Adaptation for Developmental Behavior Assessment

arXiv:2609.33082v1 Announce Type: new Abstract: Developmental screening videos show how children perform specific behaviors, but clinical records usually contain outcomes rather than descriptions of w

SGA-Flow-GRPO: Spatial Gradient-Guided Credit Assignment for Flow-GRPO

arXiv:2609.32340v1 Announce Type: new Abstract: Reinforcement Learning (RL) has proven effective in aligning flow-based generative models with human preferences. Recently, Flow-GRPO has emerged as an

SignFLIP: A Unified Model for Sign Language Translation and Generation via Stage-wise Alignment at Scale

arXiv:2609.35225v1 Announce Type: cross Abstract: Sign language translation and generation share the goal of bidirectional alignment between text and sign representations. However, existing approaches

SLIP-VLA: Single-Step Latent Imagination for Policy Learning in Vision-Language-Action Models

arXiv:2609.33575v1 Announce Type: new Abstract: Vision-Language-Action models are increasingly effective for robotic manipulation, yet most predict actions directly from current observations without e

Slot-RAE: Streamlining Object-Centric Learning via Direct Representation Auto-Encoders

arXiv:2607.11196v2 Announce Type: replace Abstract: Deploying object-centric models for real-world scene understanding typically requires complex pipelines to achieve both robust scene decomposition a

SNIP++: Fine-Grained Symbolic-Numerical Alignment for Symbolic Regression

arXiv:2609.31965v1 Announce Type: cross Abstract: Mathematical expressions and the numerical behavior they produce are two views of the same underlying function, and connecting them is central to scie

Soft Geometric Inductive Bias for Object Centric Dynamics

arXiv:2512.15493v2 Announce Type: replace Abstract: Physical systems are naturally parameterized in terms of geometric entities and their transformations. While exact equivariance can be a powerful in

SPIDER: Scalable Physics-Informed Dexterous Retargeting

arXiv:2511.09484v3 Announce Type: replace-cross Abstract: Learning agile robotic policies requires large-scale demonstrations, but translating abundant human motion data to robots is bottlenecked by t

SpikeCredit: Temporal Credit Carrier for Reinforcement Learning with Sparse Rewards

arXiv:2609.35268v1 Announce Type: new Abstract: Reinforcement learning (RL) with sparse rewards is challenging because delayed outcomes provide little guidance about which intermediate computations ca

StarOR: Synergizing Tree Search and Test-Time Reinforcement Learning for Optimization Modeling

arXiv:2606.15197v3 Announce Type: replace Abstract: Optimization modeling is inherently hierarchical, requiring a precise sequence of symbolic commitments. Traditional learning-based automated optimiz

Statistical Benefits of Fine-Tuning from Pretrained Initialization in Diagonal Linear Networks

arXiv:2609.34756v1 Announce Type: cross Abstract: Adapting pretrained models to downstream tasks with limited data has become a central paradigm in modern deep learning. Yet, despite its widespread pr

Sufficiency of Zeroth-Order Reward Shaping for Policy Gradient in Stabilization Control

arXiv:2609.34695v1 Announce Type: new Abstract: Reward shaping is fundamental to modern robotic control with deep reinforcement learning (RL), yet practitioners still rely heavily on heuristic princip

Surprising Success, Repeated Failure: Entropy-Guided Credit Assignment for Exploration in LLM Reasoning

arXiv:2609.33781v1 Announce Type: new Abstract: Reinforcement learning with verifiable rewards (RLVR) enhances reasoning in large language models (LLMs) through outcome-level feedback, yet recent appr

SymDrift: One-Shot Generative Modeling under Symmetries

arXiv:2605.06140v2 Announce Type: replace Abstract: Generative modeling of physical systems, such as molecules, requires learning distributions that are invariant under global symmetries, such as rota

SyncEdit: Rethinking Lip Synchronization as Editing with Audio-Driven Diffusion Models

arXiv:2603.09084v2 Announce Type: replace Abstract: Lip synchronization refers to the task of modifying facial lip movements such that they are temporally aligned with a given audio signal. It is a fu

TacGooseBumps (TacGB): Retrofitting Normal-Only Tactile Sensors with Shear Encoding for Learning Contact-Rich Manipulation

arXiv:2609.34006v1 Announce Type: new Abstract: Contact-rich policies often fail because distinct physical states look alike yet require different actions. Cameras may not reveal whether a connector i

Teach Yourself Where to Look: On-Policy Attention Self-Distillation for Reasoning

arXiv:2609.33200v1 Announce Type: new Abstract: On-policy self-distillation trains reasoning models on their own trajectories using dense token distribution guidance from a privileged teacher with acc

Teacher-Student Gaps Are Not Enough: Outcome-Guided On-Policy Distillation for Multi-Turn Autonomous Agents

arXiv:2609.35319v1 Announce Type: new Abstract: On-policy distillation (OPD) trains a student on its own trajectories with dense teacher supervision. Recent work on OPD for multi-turn autonomous agent

Text-Vision Synergistic Token Caching: A Training-Free Framework for Efficient Vision-Language-Action Inference

arXiv:2609.34319v1 Announce Type: new Abstract: Vision-Language-Action (VLA) models enable generalizable robotic control but remain computationally expensive. Token caching provides a training-free, p

The Devil is in the Spectrum Bias: Spectrum-Balanced Feature Matching for Robust Representation Distillation

arXiv:2609.34106v1 Announce Type: new Abstract: Large visual foundation models have demonstrated remarkable transferability across a wide range of downstream tasks. To deploy such models efficiently,

The Double-Edged Sword of Information: Revealed versus Hidden Lotteries in School Choice

arXiv:2609.34074v1 Announce Type: cross Abstract: In school choice, a lottery number is often used by the matching mechanism to break ties when there are more students who prefer the same school than

The Model Knows When to Stop: Training-Free Early Stopping for Long-Context Reading

arXiv:2609.34590v1 Announce Type: cross Abstract: Language models often process long inputs sequentially in chunks, but continuing to read after sufficient evidence has been acquired wastes computatio

The Platonic Universe: Do Foundation Models See the Same Sky?

arXiv:2509.19453v2 Announce Type: replace-cross Abstract: We investigate when foundation models converge towards shared representations, and how this convergence depends on model capacity, training re

The Statistical Benefits of Multiple Responses for Learning from Demonstrations

arXiv:2609.33291v1 Announce Type: cross Abstract: Many generative systems return multiple candidate responses and are evaluated according to the best one. Recent work shows that, when demonstrations a

Think Fast, Plan Selectively: Adaptive Deliberation for Efficient Data-Driven MPC

arXiv:2609.32591v1 Announce Type: cross Abstract: Data-driven model predictive control (MPC) combines learned world models with online trajectory optimization, achieving strong performance in continuo

TIDE: Teacher-Student Transition via Informative Distillation and Exploration for Agentic RL

arXiv:2609.35058v1 Announce Type: new Abstract: Effective multi-turn agents require interaction strategies that coordinate information gathering, actions, and feedback over long horizons. GRPO is a re

TimelyDAgger: Timing-Aware Expert Querying for VLA Policy Improvement

arXiv:2609.33157v1 Announce Type: new Abstract: DAgger improves robot policies by aggregating expert supervision from states visited during policy execution. Robot-gated DAgger automates expert querie

Timestep Weighting: A Hidden Key to Effective ELBO-Based Flow-Matching RL

arXiv:2609.32665v1 Announce Type: cross Abstract: ELBO-based reinforcement learning offers a sampler-agnostic approach to fine-tuning flow matching models with reward feedback. Timestep weighting in E

TokenCast: Forecasting Token Consumption During LLM Agent Execution

arXiv:2609.35760v1 Announce Type: new Abstract: When a large language model (LLM) agent executes the same task, token consumption can vary by over an order of magnitude across runs. The agent chooses

Train Together or Merge Later? Unifying VLA Experts via a Shared Action Interface

arXiv:2609.33125v1 Announce Type: new Abstract: Co-training offers a straightforward way to build a multi-task vision-language-action (VLA) policy, but can fall short of the performance achieved by tr

Transfer Learning for Edge Classification on Dynamic Text-Attributed Graphs

arXiv:2609.32849v1 Announce Type: new Abstract: Learning transferable representations for dynamic text-attributed graphs (DyTAGs) requires models to capture underlying interaction dynamics that persis

TSGate: Timestep-Aware Gated Attention for Diffusion Transformers

arXiv:2609.34539v1 Announce Type: new Abstract: Diffusion Transformers (DiTs) have emerged as the dominant architecture for high-fidelity image and video generation. Recent DiT systems increasingly us

TTRSD: Test-Time Reinforcement Learning with Self-Distillation for Vision-Language Models

arXiv:2609.33414v1 Announce Type: new Abstract: Test-time reinforcement learning enables vision-language models (VLMs) to adapt using unlabeled inputs. However, repeated sampling under fixed visual co

Twist, Don't Tilt: Trajectory-Exact Constrained Decoding for Masked Diffusion Models

arXiv:2609.35609v1 Announce Type: new Abstract: Constrained decoding for Masked Diffusion Language Models (MDLMs) aims to ensure that generated outputs satisfy a specified structure or syntax constrai

Two-Stage Learned Decomposition for Scalable Routing on Multigraphs

arXiv:2605.05389v2 Announce Type: replace Abstract: Most neural methods for Vehicle Routing Problems (VRPs) are limited to Euclidean settings or simple graphs. In this work, we instead consider multig

Two-Timescale Fine-tuning Provably Learns New Features for Two-Layer ReLU Networks

arXiv:2609.34667v1 Announce Type: cross Abstract: Fine-tuning pre-trained models on specialized tasks with scarce data is central to modern deep learning. Despite its empirical success, theoretical un

Unbiased Top-k Estimation for On-Policy Distillation

arXiv:2609.34447v1 Announce Type: cross Abstract: On-policy distillation (OPD) is becoming an important component of large language model (LLM) post-training for transferring the reasoning capability