Search: “safety”

In-Distribution Imagination for Model-Based Offline Reinforcement Learning

arXiv:2609.38673v1 Announce Type: new Abstract: Model-based offline reinforcement learning (MBORL) improves sample efficiency through model-generated trajectories. However, accumulative model error ca

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Interactor: Agentic RL oriented Iterative Creation for Ad Description Generation in Sponsored Search

DGX agent

arXiv:2606.15911v2 Announce Type: replace Abstract: This paper focuses on automatically generating informative ad descriptions in sponsored search. Unlike ad titles which are usually optimized to attr

safetyarxiv-cs-cl

1 Oct 2026

Is Better Teacher Supervision Enough? Unlocking Student-side Learning in Multimodal On-Policy Distillation

arXiv:2609.39120v1 Announce Type: new Abstract: On-policy distillation (OPD) improves reasoning by providing token-level supervision from a teacher on a student's own trajectories. Existing methods pr

ITO: Multi-View Alignment and Training-Time Fusion for Image-Text Pretraining

arXiv:2603.02767v4 Announce Type: replace-cross Abstract: Image--text contrastive pretraining has become a dominant paradigm for visual representation learning, yet existing methods often yield repres

It's incredibly important to aggressively resist the idea that AI can be conscious or have 'personhood,' not only because it's as ridiculous…

It's incredibly important to aggressively resist the idea that AI can be conscious or have 'personhood,' not only because it's as ridiculous as believing that a book can think, but because once this i

safetygary-marcus--x

LatentHarness: Learning Latent Actions for Memory and Reasoning via Counterfactual Policy Distillation

arXiv:2609.39740v1 Announce Type: new Abstract: Long-context reasoning faces two complementary bottlenecks: retaining evidence across long inputs and sustaining computation across many reasoning steps

LBDU-VIO: Learned Bias Dynamics and Uncertainty for Visual-Inertial Odometry with Unreliable Vision

arXiv:2609.39125v1 Announce Type: new Abstract: Visual-inertial odometry (VIO) for aerial robots relies on high rate inertial measurement unit (IMU) propagation between visual updates. However, conven

LEARN-TS: LLM-Enhanced Alignment and Reconstruction with Normality Guidance for Multivariate Time-Series Anomaly Detection

arXiv:2609.38789v1 Announce Type: new Abstract: Reconstruction errors in multivariate time-series anomaly detection may not reliably distinguish abnormal behavior from benign deviations. Language-deri

Learning Adaptive and Visually Aligned Conditions for Generative Zero-Shot Learning

arXiv:2603.06281v3 Announce Type: replace Abstract: Generative zero-shot learning (ZSL) synthesizes visual features for unseen classes by learning a semantic-conditioned generator from seen classes. S

Learning-Enabled Estimation: Tight Characterizations under Sample Selection Biases

arXiv:2609.38608v1 Announce Type: new Abstract: When can we learn from biased samples? We study regression when outcomes are observed only after passing through selection filters that depend on both c

Learning to Reason with Compressed Context: Ground-Truth-Free Adaptation of OmniLLMs via Self-Distillation

arXiv:2609.39953v1 Announce Type: new Abstract: Omni-modal large language models (OmniLLMs) enable unified audio-video understanding, but their long multimodal token sequences make deployment computat

Less Data, Better Timing: Student-Curriculum Coupling for VLM On-Policy Distillation in Temporal Video Grounding

arXiv:2609.40055v1 Announce Type: cross Abstract: On-policy distillation (OPD) provides dense supervision directly on student-generated trajectories, making it an effective post-training strategy for

Linear Recurrent Memory Suffices to Distil a World-Model Policy for Robot Air Hockey

arXiv:2609.39151v1 Announce Type: cross Abstract: Does memory-dependent control need nonlinear recurrent dynamics? We study simulated air-hockey defence under temporary loss of puck tracking. A Dreame

Locomotion-Grounded Humanoid Soccer: Task-Gated Reinforcement Learning of a Multi-Directional Kicking Library

arXiv:2609.38852v1 Announce Type: new Abstract: Recent humanoid soccer systems make motion tracking the substrate and derive locomotion from it, typically by steering a motion-reference anchor toward

LocoWM: High-Precision Locomotion through World-Model-Guided Residual Adaptation

arXiv:2609.39179v1 Announce Type: new Abstract: High-precision locomotion combines motion-command tracking with precise regulation of task-relevant physical states, enabling robots to interact reliabl

Loop-Free Inverse Reinforcement Learning via Sequential Value Recovery with Q-Score Matching

arXiv:2609.38955v1 Announce Type: cross Abstract: Inverse Reinforcement Learning (IRL) aims to recover a reward function that explains expert demonstrations. Existing IRL methods typically rely on a b

Making Grid Beam Search Less Greedy

arXiv:2609.39368v1 Announce Type: new Abstract: A common formalism for constraining the output of autoregressive text generation models involves lexical constraints, words or phrases which are require

Making LLMs Say What They Think: Measuring and Improving CoT-Interpretability Alignment

arXiv:2609.38972v1 Announce Type: cross Abstract: Chain-of-thought (CoT) traces often serve as a proxy for how Large Language Models (LLMs) arrive at their answers. However, growing evidence shows tha

Making Waves: A Membrane-Coupled Delta Array for Manipulating Objects Below the Actuator Spacing

arXiv:2609.39652v1 Announce Type: new Abstract: Distributed manipulator systems manipulate objects through the coordinated motion of many actuators. However, an object must be supported by several act

MC-PanDA++: Simpler, Stronger, and More Robust Domain-Adaptive Panoptic Segmentation

arXiv:2609.39681v1 Announce Type: new Abstract: Unsupervised domain adaptation (UDA) reduces the annotation burden in panoptic segmentation by leveraging a cost-effectively labeled source domain (e.g.

MCD: Causal Distillation of Multimodal In-Context Learning in Large Vision-Language Models

arXiv:2609.39920v1 Announce Type: cross Abstract: Large vision-language models (LVLMs) exhibit strong multimodal in-context learning (ICL) capabilities, yet this ability degrades substantially as mode

Memorize, Adapt, Ignore: Diagnosing Robot Learning Mechanisms under Training Data Variation

arXiv:2609.38401v1 Announce Type: new Abstract: Training data variation, whether through designing a domain randomization (DR) scheme in simulation or curating demonstrations for imitation learning, i

MindWorldBench: Evaluating Mental-State-to-Behavior Reasoning in Image-to-Video Generation

arXiv:2609.39147v1 Announce Type: new Abstract: Current image-to-video models achieve visual realism and physical plausibility, but reasoning about mental states remains unexplored. Actions are driven

Mitigating the Length-Scaling Tax with Online Distillation

arXiv:2609.38854v1 Announce Type: cross Abstract: Length scaling during reinforcement-learning (RL) post-training is often viewed as a sign of improved reasoning ability, especially on difficult probl

More Choices, Fewer Decisions: Ordinal-Scale Bias in JEV-like Direct-Decision Models

arXiv:2609.38827v1 Announce Type: new Abstract: Direct-decision models turn text into low-latency structured labels and scores, making them attractive for classification and automatic evaluation. Yet

Multi-LLM Collaborative Alignment via Stackelberg Games

arXiv:2609.39076v1 Announce Type: new Abstract: A pool of language models can collaborate and improve collectively by learning from one another's responses. These interactions depend on the instructio

MVP-SLAM: Multi-Camera Visual-Inertial Floorplan-Prior SLAM

arXiv:2609.39596v1 Announce Type: new Abstract: Indoor building construction sites are demanding environments for visual SLAM, where variable lighting and repetitive, low-textured structures make the

no way will this government properly police companies that it has a 10% equity stake in

no way will this government properly police companies that it has a 10% equity stake in 🚨 BREAKING: Trump REJECTS nationalizing OpenAI and Anthropic but says the US government might take an Intel-styl

safetygary-marcus--x

OGPO: One-Step Generative Policy Optimization for Real-Time Robot Control

arXiv:2601.20701v2 Announce Type: replace Abstract: Real-time robot control demands fast action generation. Diffusion and flow matching policies for robot control require multi-step sampling, limiting

On the Off-Policy Teacher in On-Policy Distillation

arXiv:2609.38360v1 Announce Type: cross Abstract: On-policy distillation (OPD) has recently emerged as a promising post-training paradigm in which the student learns from trajectories generated by its

OP-CAD: On-Policy Clean-Audio Distillation for Robust Audio-Visual Reasoning

arXiv:2609.39150v1 Announce Type: new Abstract: Omni-modal large language models deployed in real-world environments encounter external noise that can interfere with their perception and understanding

OpenJev-RLCD: A Working RLCD Implementation

arXiv:2609.38850v1 Announce Type: new Abstract: Decision models such as Jev answer questions with probabilities, which are only useful if they are calibrated. Open-source reproductions rely on supervi

OPSRD: On-Policy Self-Role Distillation

arXiv:2609.39884v1 Announce Type: cross Abstract: Role prompting elicits specialized behavior from large language models through an expert identity, offering a lightweight way to guide reasoning on de

Optimal Design for Active Preference Learning with Biased LLM Judges

arXiv:2609.38860v1 Announce Type: cross Abstract: Learning from human preferences is central to large language model (LLM) alignment, but human preference annotation is costly. Active preference learn

Optimize, Learn, Refine: Whole-Body Grasping and Pick-and-Throw with a Spiral Soft Robot

arXiv:2609.38202v1 Announce Type: new Abstract: Soft continuum robots can exploit distributed compliance for whole-body manipulation, but synthesizing behavior through changing contacts remains diffic

OPTS-TTPO: Enhancing Finite-Sample Policy-Gradient Learning with Tree Search

arXiv:2609.40035v1 Announce Type: new Abstract: The policy-gradient theorem gives the exact gradient under the current policy, but finite on-policy samples may miss rare high-return trajectories. We s

Over-Personalization Is a Decision Failure: Generation-Induced Apply Bias in LLMs

arXiv:2609.34284v2 Announce Type: replace Abstract: Personalized LLMs must decide, for each stored preference, whether the current context calls for applying or suppressing it, which we call its appli

PhasePlan: Ordered Future-Phase Planning for Robot Brain Models

arXiv:2609.39970v1 Announce Type: new Abstract: Robot brain models integrate vision, language, and robot state to generate actions for complex manipulation tasks. Most predict fixed-length action chun

PhaseSync-Exo: Human Clock Anchored Reference Adaptation for Dynamic Gait Tracking

arXiv:2609.38824v1 Announce Type: new Abstract: Human-aware exoskeleton walking requires reconstructing gait, tracking diverse motions under dynamic constraints, and preserving human timing. We presen

Policy-Conditioned AI-Use Detection: An Evidentiary Framework for Academic Publishing

arXiv:2609.38427v1 Announce Type: cross Abstract: Major venues now publish detailed rules about how authors, reviewers, and area chairs may use AI, and those rules differ by role, by task, and by what

Policy Iteration Is Not Strongly Polynomial for Deterministic Markov Decision Processes: The Price of Algorithmic Anarchy

arXiv:2609.40147v1 Announce Type: new Abstract: We establish an exponential iteration lower bound in the number of states for Howard's policy iteration on deterministic discounted Markov decision proc

Prediction is Better than Detection: Traffic Congestion Control using Drones

arXiv:2609.39637v1 Announce Type: new Abstract: A central question in deploying teams of mobile robots for persistent monitoring is how task performance scales with fleet size, and whether this scalin

PrefPI: Preference-Guided Steering into Out-of-Distribution Behaviors

arXiv:2609.40165v1 Announce Type: cross Abstract: We present PrefPI (Preference-Guided Policy Iteration), an iterative framework for steering pretrained generative robot policies using only relative p

Project and Mix: Task-Semantic Prototypes for Few-Shot Image Classification

arXiv:2603.24528v2 Announce Type: replace Abstract: Vision-language models like CLIP are trained with the objective of aligning text and image pairs. Beyond text prompts alone, recent works show that

Prototype-guided Bilateral Alignment Multimodal Federated Learning

arXiv:2609.38925v1 Announce Type: new Abstract: Multimodal federated learning (MFL) has emerged as a pivotal paradigm for leveraging distributed data to enhance model performance. However, existing me

Prototype-Rule Neurosymbolic Regularization for Rank-Constrained Tensor Neural Networks under Label Scarcity

arXiv:2609.40131v1 Announce Type: cross Abstract: Rank-constrained tensor neural networks reduce the parameterization of high-order inputs, but they do not explicitly constrain class geometry in the l

Proximal Balancing for Causal Effect Estimation under Unmeasured Confounding

arXiv:2609.40051v1 Announce Type: cross Abstract: Estimating causal effects from observational data is central to science and policy, but the effects are not identified when confounders are unmeasured

Recovering Off-Policy Supervision for Speculative Decoding

arXiv:2609.38795v1 Announce Type: new Abstract: Block drafters for speculative decoding are commonly trained on corpora written by external models, where a single off-policy token invalidates supervis