safety

per comments from @GergelyOrosz below i don’t think these data are compelling after all, and am deleting the OP

Gary Marcus deleted an original post after Gergely Orosz provided comments questioning the compelling nature of the data presented. The post appears to have been withdrawn due to critical feedback tha

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Safety

PICACO: Pluralistic In-Context Value Alignment of LLMs via Total Correlation Optimization

DGX agent

arXiv:2507.16679v3 Announce Type: replace-cross Abstract: In-Context Learning has shown great potential for aligning Large Language Models (LLMs) with human values, helping reduce harmful outputs and

safetyarxiv-cs-ai

27 May 2026

Position: Machine Learning for Heart Transplant Allocation Policy Optimization Should Account for Incentives

arXiv:2602.04990v3 Announce Type: replace Abstract: The allocation of scarce donor organs constitutes one of the most consequential algorithmic challenges in healthcare. While the field is rapidly tra

Practical Anonymous Two-Party Gradient Boosting Decision Tree

arXiv:2605.26903v1 Announce Type: cross Abstract: Structured data is well handled by gradient-boosted decision trees (GBDT), which are usually trained on vertically partitioned features across mutuall

Provably Safe Motion Planning Under Unknown Disturbances

arXiv:2605.26625v1 Announce Type: new Abstract: We present a provably safe sampling-based motion planning algorithm for robotic systems affected by random disturbances of unknown distribution. We cons

safetyarxiv-cs-ro

PyCAT4: A Hierarchical Vision Transformer-based Framework for 3D Human Pose Estimation

arXiv:2508.02806v3 Announce Type: replace Abstract: Recently, a significant improvement in the accuracy of 3D human pose estimation has been achieved by combining convolutional neural networks (CNNs)

Quantized Keys Steal Attention: Bias Correction for KV-Cache Compression in Video Diffusion

arXiv:2605.26266v1 Announce Type: cross Abstract: Chunk-wise autoregressive video diffusion models rely on a KV cache of previously generated chunks to avoid redundant computation, but this cache quic

Real Images, Worse Judgments: Evaluating Vision-Language Models on Concreteness and Imagery

arXiv:2605.27315v1 Announce Type: new Abstract: Visual inputs are often assumed to improve language understanding in multimodal models. We examine this assumption by asking whether vision-language mod

ReasonOps: A Unified Operational Paradigm for Trustworthy Verified LLM Reasoning

arXiv:2605.27014v1 Announce Type: cross Abstract: Large Language Models (LLMs) have transformed artificial intelligence from primarily generative systems into increasingly capable reasoning agents. Re

Rethinking the Trust Region in LLM Reinforcement Learning

arXiv:2602.04879v2 Announce Type: replace-cross Abstract: Reinforcement learning (RL) has become a cornerstone for fine-tuning Large Language Models (LLMs), with Proximal Policy Optimization (PPO) ser

Rethinking Weakly-supervised Video Temporal Grounding From a Game Perspective

arXiv:2605.26441v1 Announce Type: cross Abstract: This paper addresses the challenging task of weakly-supervised video temporal grounding. Existing approaches are generally based on the moment proposa

RICE-PO: Turning Retrieval Interactions into Credit Signals for Reasoning Agents

arXiv:2605.26352v1 Announce Type: new Abstract: Retrieval is increasingly moving from one-shot matching toward interactive reasoning, where language agents iteratively inspect evidence, reformulate qu

Robust Koopman Control Barrier Filters for Safe Actor-Critic Reinforcement Learning

arXiv:2605.26452v1 Announce Type: cross Abstract: Safe reinforcement learning (RL) for robotic systems requires policies that improve task performance while satisfying state and input constraints duri

Sample Complexity of Policy Gradient for Log-Growth Control

arXiv:2605.26640v1 Announce Type: cross Abstract: We study the sample complexity of policy gradient for log-growth control -- the problem of learning, from observed state transitions, a feedback gain

Scaling World-Model Reinforcement Learning Through Diffusion Policy Optimization

arXiv:2605.26282v1 Announce Type: new Abstract: Model-based reinforcement learning (RL) can be effectively supported at scale through the use of world models. However, in practice, scaling such approa

SCENT: Aligning Mass Spectra with Molecular Structure for Olfactory Perception

arXiv:2605.27009v1 Announce Type: new Abstract: Predicting human olfactory perception from molecular structure has seen remarkable progress, yet these approaches require explicit chemical structure at

SCKAN: Structural Consensus-based KAN Prototype Learning for Semi-Supervised Pancreas Segmentation

arXiv:2605.27032v1 Announce Type: new Abstract: Accurate pancreas segmentation is critical for early cancer diagnosis, where annotation scarcity necessitates Semi-Supervised Learning (SSL). However, d

Securing Multi-Agent Systems Against Corruptions via Node Contribution Backpropagation

arXiv:2510.19420v2 Announce Type: replace-cross Abstract: Multi-Agent Systems (MAS) have become a prevalent paradigm for Large Language Model (LLM) applications. However, the complex multi-agent desig

Self-Improvement Imitation with Biologically Guided Search for Protein Design Under Oracle Budgets

arXiv:2605.26690v1 Announce Type: cross Abstract: Protein sequence optimization under tight oracle budgets requires methods that explore vast combinatorial spaces while making each evaluation informat

Semantic Robustness Probing via Inpainting: An Interactive Tool for Safety-Critical Object Detection

arXiv:2605.27155v1 Announce Type: cross Abstract: Testing object detectors in safety-critical domains requires semantically meaningful probes beyond pixel-level corruptions. We present SemProbe, a too

Signal-to-Noise Ratio and Sample Size Govern Representational Alignment in Neural Networks

arXiv:2605.26973v1 Announce Type: cross Abstract: Neural networks are known to develop latent representations that are aligned, namely structurally similar across networks trained with different archi

SketchAssist: A Practical Assistant for Semantic Edits and Precise Local Redrawing

arXiv:2512.14140v2 Announce Type: replace Abstract: Sketch editing requires jointly handling high-level semantic changes and precise local redrawing, a combination that is particularly challenging for

SL-BiLEM: Structured Learnable Behavior-in-the-Loop Epidemic Modeling for Forecasting and Policy Evaluation

arXiv:2605.26704v1 Announce Type: cross Abstract: Epidemic forecasting faces a fundamental challenge: human behavior dynamically responds to disease spread, creating feedback loops that induce distrib

some data i shared yesterday on anthropic revenue possibly slowing down aren’t as a compelling as i thought; i have deleted my posts and awa…

some data i shared yesterday on anthropic revenue possibly slowing down aren’t as a compelling as i thought; i have deleted my posts and await better data before drawing conclusions. h/t @GergelyOrosz

Spectral Principal Paths: A Spectral Perspective on Linear Representation Formation in LLMs

arXiv:2506.08543v3 Announce Type: replace Abstract: High-level representations have become a central focus in enhancing AI transparency and control, shifting attention from individual neurons or circu

Spend Your Rollouts Where It Counts: Rollout Allocation for Group-Based RL Post-Training

arXiv:2605.26606v1 Announce Type: cross Abstract: Reinforcement learning (RL) is the dominant paradigm for post-training large language models. However, in the online, on-policy setting, rollout gener

SQARL: A Size-Agnostic Reinforcement Learning approach for Circuit Allocation in Distributed Quantum Architectures

arXiv:2605.27027v1 Announce Type: new Abstract: The scaling of quantum processors is currently limited by technical challenges such as decoherence and cross-talk. As the number of qubits grows, interf

Starbucks learned the hard way: you literally can’t even trust (current) AI to count.

Starbucks learned the hard way: you literally can’t even trust (current) AI to count. For some reason OpenAI doesn’t seem to be talking about how Starbucks spent years creating and testing an AI inven

StepOPSD: Step-Aware Online Preference Distillation for Agent Reinforcement Learning

arXiv:2605.27140v1 Announce Type: new Abstract: Reinforcement learning for multi-turn agents suffers from a credit-assignment mismatch: rewards are sparse and trajectory-level, while success often hin

Stochastic Decision Horizons for Constrained Reinforcement Learning

arXiv:2602.04599v2 Announce Type: replace Abstract: We propose stochastic decision horizons (SDH), a theoretically grounded framework for solving constrained RL problems with every-step constraint sat

TAGRPO: Boosting GRPO on Image-to-Video Generation with Direct Trajectory Alignment

arXiv:2601.05729v2 Announce Type: replace Abstract: Recent studies have demonstrated the efficacy of integrating Group Relative Policy Optimization (GRPO) into flow matching models, particularly for t

The AI Cognitive Trojan Horse: How Large Language Models May Bypass Human Epistemic Vigilance

arXiv:2601.07085v2 Announce Type: replace-cross Abstract: Large language model (LLM)-based conversational AI systems present a challenge to human cognition that current frameworks for understanding mi

The Coverage Illusion: From Pre-retrieval Routing Failure to Post-retrieval Cascades in a Production RAG System

arXiv:2605.27220v1 Announce Type: new Abstract: In modern RAG pipelines, query augmentation methods such as HyDE and query expansion are applied to every query, resulting in substantial LLM inference

The Labyrinth and the Thread: Rethinking Regularizations in Sequential Knowledge Editing for Large Language Models

arXiv:2605.26670v1 Announce Type: cross Abstract: Sequential editing of structured knowledge in large language models allows targeted factual updates without retraining, yet existing methods often rel

The Rescue Effect: Spatio-Semantic Early Exit Bypasses Quantization Collapse in CLIP

arXiv:2605.26415v1 Announce Type: cross Abstract: Deploying Vision-Language Models on resource-constrained hardware typically requires INT8 quantization, but in joint-embedding architectures such as C

The Role of Causal Features in Strategic Classification for Robustness and Alignment

arXiv:2605.27163v1 Announce Type: new Abstract: In strategic classification, an institution (e.g., a bank) anticipates adaptation from users who change their features to increase utility in a classifi

Think Twice Before You Act: Enhancing Agent Behavioral Safety with Thought Correction

arXiv:2505.11063v3 Announce Type: replace Abstract: LLM-based agents solve complex tasks through iterative reasoning, tool use, and environment interaction, where each intermediate thought directly sh

This is fearmongering, @davidsacks, afaik. I see no candidate regulation being taken seriously that is an actual threat to the trillion doll…

This is fearmongering, @davidsacks, afaik. I see no candidate regulation being taken seriously that is an actual threat to the trillion dollar AI companies (which can easily afford whatever compliance

To model human linguistic prediction, make LLMs less superhuman

arXiv:2510.05141v2 Announce Type: replace Abstract: When we read, we make predictions about upcoming words; these predictions influence our reading behavior. The success of large language models (LLMs

“Tokens got burned for millions of dollars without any real significant ROI to show for it.” hearing this over and over again

“Tokens got burned for millions of dollars without any real significant ROI to show for it.” hearing this over and over again The same conversation is happening across tech right now and many of us sa

TPS-Drive: Task-Guided Representation Purification for VLM-based Autonomous Driving

arXiv:2605.27038v1 Announce Type: new Abstract: Vision-Language Models (VLMs) provide a promising foundation for autonomous driving planning, yet bridging semantic reasoning and precise 3D spatial for

safetyarxiv-cs-ro

Triadic Dynamics Aware Diffusion Posterior Sampling for Inverse Problems: Optimizing Guidance and Stochasticity Schedules

arXiv:2605.26470v1 Announce Type: new Abstract: Generative posterior sampling using diffusion models has emerged as a dominant paradigm for solving inverse problems in imaging, which usually consists

Trust, Geometry, and Rules: A Credibility-Aware Reinforcement Learning Framework for Safe USV Navigation under Uncertainty

arXiv:2605.26974v1 Announce Type: new Abstract: Autonomous navigation of Unmanned Surface Vehicles (USVs) that is safe and compliant with the International Regulations for Preventing Collisions at Sea

safetyarxiv-cs-ro

Turning Bias into Bugs: Bandit-Guided Style Manipulation Attacks on LLM Judges

arXiv:2605.26156v1 Announce Type: cross Abstract: The known stylistic biases in LLM judges, such as a preference for verbosity or specific sentence structures, present an underexplored security vulner

UCPO: Uncertainty-Aware Policy Optimization

arXiv:2601.22648v2 Announce Type: replace Abstract: The key to building trustworthy large language models (LLMs) lies in endowing them with inherent uncertainty expression capabilities, thereby mitiga

Uniboost: Global Coordination with Value Alignment for Fair and Efficient Traffic Allocation

arXiv:2605.26424v1 Announce Type: cross Abstract: With the rapid evolution of internet services, recommendation systems have become indispensable. In particular, the blending (re-ranking) stage plays

Unique Lives, Shared World: Learning from Single-Life Videos

arXiv:2512.04085v2 Announce Type: replace Abstract: We introduce the 'single-life' learning paradigm, where we train a distinct vision model exclusively on egocentric videos captured by one individual

V2V3D: View-to-View Denoised 3D Reconstruction for Light-Field Microscopy

arXiv:2504.07853v2 Announce Type: replace Abstract: Light field microscopy (LFM) has gained significant attention due to its ability to capture snapshot-based, large-scale 3D fluorescence images. Howe