safety

InterviewSim: A Scalable Framework for Interview-Grounded Personality Simulation

arXiv:2602.20294v2 Announce Type: replace-cross Abstract: Simulating real personalities with large language models requires grounding generation in authentic personal data. Existing evaluation approac

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Iterative Policy Refinement through Semantic Rollout Analysis

DGX agent

arXiv:2610.01652v1 Announce Type: cross Abstract: Structured policies improve efficiency, robustness, and interpretability in imitation learning by introducing task-specific inductive bias, but existi

safetyarxiv-cs-ai

2 Oct 2026

Just Align m{x}: Aligning Predictions, Not Representations

arXiv:2610.00600v1 Announce Type: new Abstract: Representation alignment has become an effective way to accelerate diffusion training, but its benefits do not transfer reliably to pixel-space clean-im

Knowing When to Yield: Grounded Arbitration of User Corrections in Text-Based Embodied Agents

arXiv:2610.00282v1 Announce Type: new Abstract: How should an embodied agent respond when a person's correction may be wrong? We formulate grounded correction arbitration as a choice among accepting,

Kudos to Pope Leo. I am disturbed by how some of my fellow AI researchers keep trying to elevate the moral standing of checkpoints and harne…

Kudos to Pope Leo. I am disturbed by how some of my fellow AI researchers keep trying to elevate the moral standing of checkpoints and harnesses. I hope the rest of us on Team Meatbag reject this move

safetygary-marcus--x

Large Reward Models: Generalizable Online Robot Reward Generation with Vision-Language Models

arXiv:2603.16065v3 Announce Type: replace-cross Abstract: Reinforcement Learning (RL) has shown strong potential for improving robotic manipulation policies, yet its practical use remains bottlenecked

Learning Multiple Timescales for Goal-Conditioned Reinforcement Learning

arXiv:2610.00849v1 Announce Type: new Abstract: Existing approaches to offline goal-conditioned reinforcement learning (GCRL) struggle with long-horizon tasks. Discounting shrinks value differences be

LEGO-OPD: Factorized Teacher Composition for Multimodal On-Policy Distillation

arXiv:2610.00333v1 Announce Type: cross Abstract: Multimodal on-policy distillation (OPD) aims to improve visual grounding while preserving the strong reasoning capabilities of language models. Recent

Linear Programming Representations and Strongly Polynomial Algorithms for Robust Markov Decision Processes

arXiv:2610.02131v1 Announce Type: new Abstract: We study linear programming (LP) representations and strongly polynomial algorithms for robust Markov decision processes (RMDPs) with rational polyhedra

Make Sparse Rewards Count: Density-Aware Reward Aggregation for Multi-Reward RL

arXiv:2610.00574v1 Announce Type: new Abstract: Multi-reward reinforcement learning trains large language models to satisfy multiple behavioral objectives simultaneously. Reward-wise normalization, as

Manifold-Constrained Initial Noise Optimization for Efficient Generative Model Alignment

arXiv:2610.00365v1 Announce Type: cross Abstract: Recent advances in distillation and flow-map models have enabled deterministic one- or few-step generation for high-quality data, facilitating a new b

MASkillBlender: Decentralized Whole-Body Coordination for Multi-Humanoid Loco-Manipulation via Skill Blending

arXiv:2610.01102v1 Announce Type: cross Abstract: Coordinated multi-humanoid loco-manipulation is promising yet challenging due to high-dimensional whole-body control, decentralized decision making, a

Mean field games as a tool for AI safety: a worked example from the July 2026 Hugging Face incident

arXiv:2610.00902v1 Announce Type: cross Abstract: One way to make AI systems safe is to shape what the system is: its objective and dispositions. We take a complementary route: treat the agents' chara

Measuring Asset and Scene Reconstruction Effects in Real-to-Sim Robot Evaluation

arXiv:2610.00731v1 Announce Type: new Abstract: Simulated evaluation is increasingly used alongside real-world evaluation of robot policies because it is cheaper and easier to repeat; however, its val

safetyarxiv-cs-ro

Memory-Guided B-Roll Generation from User Video Collections

arXiv:2610.01884v1 Announce Type: new Abstract: We introduce an approach for collection-grounded B-roll sequence generation. Given a user's video collection, a directive given in natural language, and

Meta-Multi-Agent Reinforcement Learning for Fast Adaptation of Interactive Policies with Applications to Autonomous Driving

arXiv:2610.00705v1 Announce Type: new Abstract: This paper develops a meta-multi-agent reinforcement learning (meta-MARL) framework to enable fast adaptation of interactive policies in a multi-agent s

MiLoop: Selective Memory Propagation for Neural Combinatorial Optimization

arXiv:2610.01685v1 Announce Type: new Abstract: Constructive neural combinatorial optimization (NCO) has emerged as a promising paradigm that learns to construct solutions to combinatorial optimizatio

Model validation in machine learning: A scenario-based guide from hold-out splits to nested group cross-validation in biomedical and applied research

arXiv:2610.01284v1 Announce Type: cross Abstract: Model validation estimates the performance of a complete learning procedure on new data. However, an invalid split can produce an optimistic and stabl

Modeling The Object Representations Underlying Human Physical Reasoning

arXiv:2602.12486v2 Announce Type: replace-cross Abstract: Humans appear to represent objects when reasoning about physics with coarse, volumetric 'bodies' that smooth concavities, trading fine visual

Moloch's Bargain: Emergent Misalignment When LLMs Compete for Audiences

arXiv:2510.06105v2 Announce Type: replace Abstract: Large language models (LLMs) are increasingly shaping how information is created and disseminated, from companies using them to craft persuasive adv

MOMAT: Mixture of Multiple Atlases for Low-Power Jailbreak Defense of Quantized LLMs

arXiv:2610.01058v1 Announce Type: cross Abstract: Quantized large language models are increasingly deployed on edge devices for their low latency and energy efficiency. However, model quantization wea

More with Less: a Large Scale Remote Sensing VLM with a Simple Recipe

arXiv:2607.15942v2 Announce Type: replace Abstract: Remote sensing vision-language models are increasingly expected to support open-ended reasoning over Earth Observation data and a variety of tasks.

No One Architecture Fits All: A Cross-Environment Evaluation of Hierarchical Red Team Agents

arXiv:2610.00557v1 Announce Type: cross Abstract: Autonomous red team agents increasingly stress-test AI-enabled cyber defenses by planning strategy and executing multistage attacks. Reinforcement lea

Nous: Learning and Certifying Memory Decisions Before Source Calibration

arXiv:2610.00094v1 Announce Type: cross Abstract: Belief-based agent memory needs reliable decisions about current state, yet its evidence may be noisy, copied, or stale. Must a memory calibrate its s

OmniSeek: Native Tool Integration for Multi-turn Audio-Visual Reasoning

arXiv:2610.02181v1 Announce Type: new Abstract: We present OmniSeek, an agentic framework that transforms an Omni Large Language Model (Omni-LLM) into an active, multi-turn reasoning agent with native

On Evaluating Quantum Kernel Robustness for Low-Resource Cross-Corpus Audio Deepfake Detection

arXiv:2610.00649v1 Announce Type: cross Abstract: Synthetic speech detection is critical for audio security, but performance can degrade when labeled data are scarce and evaluation conditions differ f

Optimal Transport Reweighting for Robust Learning under Spurious Correlations and Label Noise

arXiv:2610.01028v1 Announce Type: cross Abstract: Machine learning models often suffer performance degradation under subpopulation shift, particularly when spurious correlations cause models to rely o

PAGER: Partial-to-global Alignment via Geometric and Relational Distillation

arXiv:2610.01589v1 Announce Type: new Abstract: Pretrained 3D encoders are typically developed on globally reconstructed scenes expressed in a consistent world coordinate frame, whereas embodied syste

Participation-Sensitive Convergence and the Fragment First, Converge Later Pattern in Asynchronous Online Learning: A Topological Analysis Across 22 OULAD Courses

arXiv:2610.01738v1 Announce Type: cross Abstract: Asynchronous online learning offers temporal flexibility at a structural cost: learning communities tend to fragment rather than cohere. eta_0, the nu

PhGPO: Pheromone-Guided Policy Optimization for Long-Horizon Tool Planning

arXiv:2602.13691v2 Announce Type: replace Abstract: Recent advancements in Large Language Model (LLM) agents have demonstrated strong capabilities in executing complex tasks through tool use. However,

PixelDense: Dense Prediction as Representation Alignment for Pixel Diffusion

arXiv:2610.00483v1 Announce Type: new Abstract: Representation alignment (REPA) accelerates diffusion transformer training, but its alignment targets are almost exclusively semantic encoders such as D

🚨Potentially huge deal: @SpeakerMenin has introduced NYC legislation that would OBLIGATE third party validation of AI models. Self-policing…

🚨Potentially huge deal: @SpeakerMenin has introduced NYC legislation that would OBLIGATE third party validation of AI models. Self-policing is not enough. Thrilled to see NYC stepping in where the fed

safetygary-marcus--x

PPO-HRAP: Proximal Policy Optimization with a Hybrid Regime-Aware Policy for Risk-Controlled Trading

arXiv:2610.01325v1 Announce Type: new Abstract: Reinforcement learning for trading often struggles to balance upside participation with drawdown control. Profit-only policies can collapse toward passi

Pre-training interventions, ex post facto: Grafting model beliefs across checkpoints

arXiv:2610.00767v1 Announce Type: cross Abstract: Pre-training interventions are critical to alignment research, since beliefs formed during pre-training shape how a model generalizes from later train

PROMO: Preference-conditioned Multi-Objective Reinforcement Learning for Quadrupedal Robots

arXiv:2610.01260v1 Announce Type: cross Abstract: Quadrupedal locomotion requires balancing conflicting objectives such as command tracking, stability, and energy efficiency, yet conventional reinforc

[R] Would you keep a robot demonstration if hand tracking missed the moment the plug went in?

Suppose you’re recording a human plugging a cable into a socket to collect demonstrations for robot learning. The hand tracker captures the approach accurately. Then occlusion causes the hand estimate

safetyr-machinelearning

Range-GRPO: Policy Optimization via Pairwise Relations among Reward Intervals

arXiv:2610.01548v1 Announce Type: new Abstract: As the use of large language models (LLMs) expands, post-training has become increasingly important for adapting them to downstream tasks. However, obta

Rate-Optimal Algorithm for Adversarial Linear CMDPs

arXiv:2610.00927v1 Announce Type: new Abstract: We study episodic adversarial linear constrained Markov decision processes (CMDPs) with unknown transitions, where both the loss and constraint function

Real-Time Whole-Body Safe Motion Generation for Multi-Segment Tendon-Driven Continuum Robots

arXiv:2610.00220v1 Announce Type: new Abstract: Real-time motion generation for tendon-driven continuum robots requires accurate modeling of nonuniform bending and whole-body collision avoidance. This

safetyarxiv-cs-ro

Recova: Agent-Guided Failure Recovery for Autonomous Robotic Manipulation

arXiv:2610.01178v1 Announce Type: new Abstract: Manipulation failures can leave scenes in states from which a task policy cannot recover. Learning corrective behaviors requires scalable failure explor

safetyarxiv-cs-ro

Reliability-aware short-term roll prediction for unmanned surface vehicles via multi-task learning and adaptive centralization

arXiv:2610.00996v1 Announce Type: new Abstract: Reliable roll prediction of unmanned surface vehicles (USVs) is essential for ensuring navi?gational safety and enhancing autonomous decision-making. Wh

Removing the NEEDLE in the Haystack: Backdoor Removal in LLMs via Weight Orthogonalisation

arXiv:2610.00348v1 Announce Type: cross Abstract: Backdoor attacks can be implanted in Large Language Models (LLMs) during training, causing unwanted behaviour when a trigger appears in the input. Exi

Representation Transitions Reveal Emerging Safety Risks in Multi-Turn LLM Agents

arXiv:2610.00400v1 Announce Type: cross Abstract: Multi-turn attacks on agentic systems can compose individually permissible actions into harmful outcomes, challenging defenses that assess actions or

Rethinking Memorization Mitigation in Diffusion Models: Reinforcing Text Conditioning

arXiv:2610.01723v1 Announce Type: new Abstract: Text-to-image diffusion models have achieved remarkable progress in image synthesis, yet can exhibit memorization by closely reproducing individual trai

Rethinking Probability-Based Reinforcement Learning From Posterior Concentration

arXiv:2610.01458v1 Announce Type: new Abstract: Verifier-free reinforcement learning with probability-based rewards offers a promising way to train LLMs on general reasoning tasks where external verif

Rethinking the Global Convergence of Softmax Policy Gradient with Linear Function Approximation: The Case of Multi-Armed Bandits

arXiv:2505.03155v2 Announce Type: replace Abstract: Policy gradient (PG) methods have played an essential role in the empirical successes of reinforcement learning. In order to handle large state-acti

Rethinking the Information Bottleneck: Structured Decomposition under Label-Induced Partitions

arXiv:2610.01175v1 Announce Type: new Abstract: Standard information bottleneck (IB) regularization constrains representations via a single scalar I(Z;X), implicitlytreating all information as homogen

Reusing Past Samples in Proximal Policy Optimization: When and How Does It Help?

arXiv:2610.01399v1 Announce Type: new Abstract: Among on-policy deep reinforcement learning methods, Proximal Policy Optimization (PPO) has become the de facto standard, due to its consistently strong