Search: “safety”

KPI: A Promptable Kernel for Physical Interaction on Humanoids

arXiv:2609.36151v1 Announce Type: new Abstract: Humanoids now walk, balance and reach with remarkable generality: one whole-body tracking policy follows references from a human, or from an end-to-end

safetyarxiv-cs-ro

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

KUPAS MASTER: Distilling the Tacit Expertise of Master Practitioners into Agent-Ready Experience Corpora

DGX agent

arXiv:2609.37673v1 Announce Type: new Abstract: Experienced professionals know more than just facts and conclusions. They know which cues matter, why a judgment is reasonable, and which action to take

safetyarxiv-cs-ai

30 Sept 2026

Language as the Interface: Foundation-Model Contrastive Learning Links Transcriptomes and Electrophysiology

arXiv:2609.37024v1 Announce Type: new Abstract: Integrating transcriptomic and electrophysiological data is essential for building multimodal foundation models for neuroscience. Patch-seq provides pai

Large-scale factor analysis shows machine intelligence is only partially interpretable

arXiv:2609.36515v1 Announce Type: cross Abstract: A common assumption in language model development is that cognitive abilities are organized around a general, domain-free intelligence factor, like fl

LatentSift: Policy-State Filtering for Token-Efficient Verification of Software Engineering Agents

arXiv:2609.36371v1 Announce Type: cross Abstract: Test-time scaling improves software engineering agents by generating multiple candidate trajectories and selecting the best one. Verifying and selecti

Learn from the Gap: Differential-Aware Advantage Pruning with Adaptive Rollout Sampling for GRPO

arXiv:2609.36932v1 Announce Type: new Abstract: Recently, Group Relative Policy Optimization (GRPO) and its variants have been developed for policy optimization and demonstrated notable performance ga

Learned Reporting Preferences in RLVR Can Conflict with the Current Request

arXiv:2609.36587v1 Announce Type: new Abstract: Reinforcement learning with verifiable rewards (RLVR) has become a prominent approach for improving language-model performance on reasoning tasks using

Learning Beyond What You Sample: Off-Policy-Aware Cross-Model Trajectory Exchange for RLVR

arXiv:2609.37868v1 Announce Type: cross Abstract: Reinforcement Learning with Verifiable Rewards (RLVR) methods such as GRPO rely on successful self-generated trajectories, but finite rollout budgets

Learning Expressive and Compositional Motion Representation via Spectral Skills

arXiv:2609.37677v1 Announce Type: new Abstract: Robotic foundation models offer a promising path toward general-purpose humanoid robot control, often through hierarchical architectures. However, their

safetyarxiv-cs-ro

Learning from Think-Mode Advantage via On-Policy Distillation

arXiv:2609.37044v1 Announce Type: new Abstract: Explicit intermediate reasoning gives large language models (LLMs) a stronger problem-solving mode. We study learning from this think-mode advantage via

Learning from Viable Failure Prefixes: Milestone Viability Potential Policy Optimization for Long-Horizon LLM Agents

arXiv:2609.37111v1 Announce Type: new Abstract: Long-horizon LLM agents require reinforcement learning methods that can assign credit to intermediate decisions under sparse and delayed rewards. Existi

Learning What to Remember: Long-horizon Counterfactual Memory Optimization

arXiv:2609.37930v1 Announce Type: new Abstract: Persistent textual memory allows language models to carry information across long interactions, but learning what to remember is fundamentally a credit-

LIFT: Layout-In-Future Video Generation under Large Viewpoint Change via On-Policy Self-Distillation

arXiv:2609.38146v1 Announce Type: new Abstract: We introduce LIFT, a unified image-to-video generation framework that complements camera control with Layout-In-FuTure control, enabling users to specif

LLM utility has increased, and deeper understanding to a degree, but I still very much agree with this post from 2020 @GaryMarcus

LLM utility has increased, and deeper understanding to a degree, but I still very much agree with this post from 2020 @GaryMarcus Forgets GPT~3. Real #AI news of 2020 is that @ylecun & Y Bengio have c

safetygary-marcus--x

Looped Actor: Depth-Recurrent Reasoning Models for Reinforcement Learning

arXiv:2609.37432v1 Announce Type: new Abstract: Looped reasoning models repeatedly apply a shared set of parameters, enabling more computation without increasing the model size. These models also supp

Lucid Dreaming for World Models: Learning to Doubt Imagination and Decide by Trust

arXiv:2609.37156v1 Announce Type: cross Abstract: World models enable agents to learn and plan in imagination, but predictions beyond their experience can become unreliable and mislead decisions. Exis

Markovian Nonconvex ADMM for Reinforcement Learning: Bellman-Resolvent Stability Beyond Smooth Blocks

arXiv:2609.36859v1 Announce Type: new Abstract: We identify and study a structural mechanism for Markovian nonconvex ADMM in reinforcement learning. Using finite discounted MDPs as a canonical proving

MeanFlowAdvantage: Stable Reward Fine-Tuning for Few-Step Average-Velocity Generators

arXiv:2609.37670v1 Announce Type: new Abstract: MeanFlow enables efficient few-step generation by predicting interval-average velocities, but this representation creates a mismatch for reward fine-tun

Mixture of Self-Improving Branches For Agent Harness Optimization

arXiv:2609.37834v1 Announce Type: new Abstract: Harness optimization provides a practical setting for recursive self-improvement (RSI), where agent-generated modifications inform subsequent changes th

MotionInsight: Diagnosing Object Motion Deficiencies in Generated Videos

arXiv:2609.37030v1 Announce Type: cross Abstract: Despite rapid progress in video generation models, they still exhibit obvious motion deficiencies, often manifested as incorrect object motion. Howeve

MotorMind: Scaffolding General Vision Language Models for Zero-Shot Robot Manipulation

arXiv:2609.38078v1 Announce Type: new Abstract: Vision-language-action (VLA) models have advanced robotic manipulation, but their zero-shot generalization in new tasks and environments remains limited

safetyarxiv-cs-ro

Multi-Granularity Language-Guided Imitation Learning via Instruction Decomposition

arXiv:2609.37135v1 Announce Type: new Abstract: Using language instructions as conditions to guide robot policy learning has recently become an important research domain. However, existing language-gu

NesTok: Nested Self-Aligned 1D Tokenizer for Autoregressive Image Generation

arXiv:2609.36756v1 Announce Type: cross Abstract: One-dimensional (1D) variable-length visual tokenizers enable adaptive compression by varying the number of tokens, allowing downstream autoregressive

Non-Myopic Active Feature Acquisition via Pathwise Policy Gradients

arXiv:2605.05511v2 Announce Type: replace Abstract: Active feature acquisition (AFA) considers prediction problems in which features are costly to obtain and the learner adaptively decides which featu

OFBD: Object-Focused Background Debiasing for Long-Tailed Learning

arXiv:2609.37331v1 Announce Type: new Abstract: Balancing performance trade-offs on long-tailed data distributions remains a long-standing challenge in visual recognition. Existing methods mainly impr

OmniTaskonomy: When Does Visual Generation Improve Visual Understanding?

arXiv:2609.38079v1 Announce Type: new Abstract: Training a model to generate visual content can encourage it to learn rich perceptual capabilities related to geometry, spatial relationships, and objec

On the Approximation and Convergence of Distributional Policy Gradient Algorithms for Risk-Sensitive Reinforcement Learning

arXiv:2405.14749v3 Announce Type: replace-cross Abstract: Risk-sensitive reinforcement learning (RL) is crucial for maintaining reliable performance in high-stakes applications. While traditional RL m

One Geometry, Different Outcomes: Readout-Dependent Effects of the Modality Gap in Vision-Language Models

arXiv:2609.36101v1 Announce Type: cross Abstract: Contrastive vision-language models learn shared embedding spaces by aligning matched image-text pairs, yet their representations remain separated by a

OpenAI-HuggingFace: A Reproduction & Lessons for Alignment Testing

arXiv:2609.35799v1 Announce Type: new Abstract: In July 2026, OpenAI's agents coordinated over channels outside their intended environment to breach Hugging Face's secured infrastructure. Could existi

Optimal Multi-Reward Reinforcement Learning

arXiv:2609.36486v1 Announce Type: new Abstract: We study an unknown-transition finite-horizon Markov decision process (MDP) with a finite collection of known reward functions {r^1, r^2, ldots, r^M}. T

Optimizer-dependent training dynamics converge to the same one-third optimal data scaling

arXiv:2609.37745v1 Announce Type: new Abstract: Neural scaling, in which loss falls as a power law with training, is central to large language models, and one recent proposal is that a 1/3 exponent em

OTROPE: Optimal Transport-based Robust Off-policy Evaluation for Large Language Models

arXiv:2609.36264v1 Announce Type: new Abstract: Reliable evaluation of large language models (LLMs) is essential for their development and deployment, yet is often costly, risky, and difficult to perf

Overcoming Scaling Limits in On-Policy Self-Distillation for LLM Reasoning

arXiv:2609.37915v1 Announce Type: cross Abstract: On-policy self-distillation (OPSD) trains a student to match a privileged teacher distribution along its own sampled trajectory. Standard OPSD applies

PADME: Preference Alignment Data Synthesis for Meta-Evaluation of LM Agent Evaluators

arXiv:2609.36086v1 Announce Type: cross Abstract: Language models are frequently employed to evaluate other language models. An LM evaluator scoring agentic behaviors across multiple criteria is valua

Pair Difficulty Matters: Rethinking Pairwise LLM-as-a-Judge Evaluation and Consistency

arXiv:2609.37577v1 Announce Type: new Abstract: Large Language Model judges are widely used to rank texts and text-generating systems through pairwise comparison, and their reliability is typically as

PE-OPSD: Internalizing Prompt Enhancement into Flow-matching Models via On-Policy Self-Distillation

arXiv:2609.36638v1 Announce Type: cross Abstract: Text-to-image users often provide concise and underspecified prompts, whereas generative models benefit from detailed textual conditions for reliable

POET: Preference Optimization for Enhanced Text-to-Image Generation

arXiv:2510.12041v3 Announce Type: replace Abstract: Recent advances in text-to-image (T2I) generation have achieved impressive results, yet existing models often struggle with simple or underspecified

Pointwise or Pairwise: When Do Pairwise Losses Help Reward Learning, Provably?

arXiv:2609.37209v1 Announce Type: new Abstract: Pairwise losses are increasingly used for reward learning even when pointwise rewards are observed, with mixed empirical results. When and why do pairwi

Population Fidelity: Evaluating Population Representativeness in LLMs

arXiv:2609.36253v1 Announce Type: cross Abstract: Large language models (LLMs) show considerable potential in simulating human attitudes and preferences. Prior work finds that LLM-generated responses

PowerSim: Differentiable Physics Simulation and Rendering with Power Diagrams

arXiv:2609.38153v1 Announce Type: new Abstract: We introduce PowerSim, a method to bring physically grounded, differentiable dynamics to PowerFoam's power diagram based 3D representation. PowerSim dir

Model Releases

PowerZooJax: A JAX-based Power System Benchmark for Reinforcement Learning

model-releasesarxiv-cs-ai

arXiv:2609.36052v1 Announce Type: new Abstract: Power system operation is a safety-critical sequential decision-making problem, making it a natural testbed for reinforcement learning (RL). However, ex

PR-OPD: Privileged Representation On-policy Self-Distillation for Agentic Reinforcement Learning

arXiv:2609.36642v1 Announce Type: new Abstract: Language-model agents are usually trained by reinforcement learning from one reward per episode, and privileged self-distillation enriches it by letting

PrimeSeeker: Capability-Oriented Supervision for Deep Search Agents

arXiv:2609.35816v1 Announce Type: cross Abstract: Large language model search agents are often trained with synthetic questions whose difficulty is increased through larger evidence graphs, additional

Privy to the Foil: Recasting Value Estimation with a Self-Privileged Critic for RLVR

arXiv:2609.37825v1 Announce Type: cross Abstract: Assigning credit to intermediate steps remains a central challenge in training Large Language Models (LLMs) on multi-step reasoning tasks with sparse

Prompts Live on an Arc: Gaussian Curricula in Fisher--Rao Coordinates for Rollout-Efficient GRPO

arXiv:2609.38018v1 Announce Type: new Abstract: Group relative policy optimization (GRPO) learns only from prompts whose sampled responses disagree: a group that is entirely correct or entirely incorr

Pruning for Efficiency, Paying in Fairness: Demographic Disparities in Pruned Speech-LLMs

arXiv:2609.38106v1 Announce Type: cross Abstract: Speech-LLMs are expensive to run, making compression important for real-world deployment. However, compressed models are usually selected using aggreg

Question-Specific Knowledge Graphs for Efficient Visual Reasoning

arXiv:2609.35942v1 Announce Type: new Abstract: Recent work in visual question answering has shown that vision-language models can exhibit strong reasoning capabilities by translating visual inputs in

RA-CFGCache: From Branch-Level Criteria to Guided-Risk Control under Classifier-Free Guidance

arXiv:2609.36433v1 Announce Type: new Abstract: Diffusion models enable high-quality visual generation, but iterative denoising remains computationally expensive, especially under classifier-free guid