safety

MATCHA: Matching Text via Contrastive Semantic Alignment

arXiv:2605.27345v1 Announce Type: new Abstract: Reliable evaluation is essential for understanding large language model (LLM) performance, yet today's go-to metrics, namely token-overlap scores (e.g.,

safetyarxiv-cs-cl

Measuring Prediction Uncertainty in Neural Cellular Automata

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

DGX agent

arXiv:2605.26726v1 Announce Type: cross Abstract: Neural cellular automata (NCA) provide a lightweight alternative to encoder-decoder segmentation networks. However, it can be difficult to decide when

safetyarxiv-cs-ai

27 May 2026

MechRL: Reinforcement Learning Agents Perform Circuit Discovery for Mechanistic Interpretability

arXiv:2605.26343v1 Announce Type: new Abstract: Mechanistic interpretability has identified small sets of attention heads that implement specific behaviours in transformer language models, but recover

MemMorph: Tool Hijacking in LLM Agents via Memory Poisoning

arXiv:2605.26154v1 Announce Type: cross Abstract: LLM-driven agents are capable of selecting external tools to complete users' tasks. However, attackers could compromise such process, steering agents

🚨 MICHAEL BURRY WARNS THREE UPCOMING IPOs COULD COMPLETELY CRASH THE STOCK MARKET. Michael Burry reported that the upcoming public listings…

🚨 MICHAEL BURRY WARNS THREE UPCOMING IPOs COULD COMPLETELY CRASH THE STOCK MARKET. Michael Burry reported that the upcoming public listings for SpaceX, OpenAI, and Anthropic are going to pull more cap

Mildly Overparameterized ReLU Networks on Orthogonal Data: Incremental Learning and Implicit Bias

arXiv:2605.27097v1 Announce Type: new Abstract: The successful training of neural networks hinges on the use of first order optimization methods, yet the theoretical characterization of these methods

Modernising Reinforcement Learning-Based Navigation for Embodied Semantic Scene Graph Generation

arXiv:2603.25415v2 Announce Type: replace Abstract: Semantic world models enable embodied agents to reason about objects, relations, and spatial context beyond purely geometric representations. In Org

Monte Carlo Permutation Search

arXiv:2510.06381v2 Announce Type: replace-cross Abstract: We propose Monte Carlo Permutation Search (MCPS), a general-purpose Monte Carlo Tree Search (MCTS) algorithm that improves upon the GRAVE algo

More CEOs saying the obvious. AI has been hyped so much over the last few years that every other technology, market trend, and idea is overl…

More CEOs saying the obvious. AI has been hyped so much over the last few years that every other technology, market trend, and idea is overlooked. When will be get past the mania about imminent AGI, c

Multi-Stakeholder LLM Alignment: Decomposing Estimation from Aggregation

arXiv:2605.26878v1 Announce Type: new Abstract: Multi-stakeholder tasks require one output to satisfy users with conflicting preferences. Holistic LLM judges conflate utility estimation and utility ag

MVISTA-4D: View-Consistent 4D World Model with Test-Time Action Inference for Robotic Manipulation

arXiv:2602.09878v2 Announce Type: replace Abstract: World-model-based imagine-then-act becomes a promising paradigm for robotic manipulation, yet existing approaches typically support either purely im

Neuro-Symbolic Verification of LLM Outputs for Data-Sensitive Domains (extended preprint)

arXiv:2605.26942v1 Announce Type: new Abstract: LLMs deployed in high-stakes domains face fundamental reliability challenges: hallucinations, inconsistencies, and privacy vulnerabilities introduce una

Olaf-World: Orienting Latent Actions for Video World Modeling

arXiv:2602.10104v2 Announce Type: replace-cross Abstract: Scaling action-controllable world models is limited by the scarcity of action labels. While latent action learning promises to extract control

On the Push-Based Asynchronous Federated Learning: A Bias-Correction Aggregation Approach

arXiv:2605.26162v1 Announce Type: cross Abstract: Asynchronous decentralized federated learning (ADFL) eliminates central coordination and global synchronization, making it attractive for large-scale

On the Role of Inductive Bias in Time-Series Pretraining: A Case Study in Learning Generalizable Representations for Clinical Time Series

arXiv:2605.26194v1 Announce Type: new Abstract: Clinical time-series learning is routinely constrained by small, heterogeneous cohorts and protocol drift, while its downstream use spans both classific

Only thing completely clear about the future of work is that Altman and Amodei will say whatever they think will drive up their IPOs.

Only thing completely clear about the future of work is that Altman and Amodei will say whatever they think will drive up their IPOs. Altman and Amodei have said for years that AI was so powerful that

Open-Weight LLM Fine-Tuning Defenses are Susceptible to Simple Attacks

arXiv:2605.26526v1 Announce Type: new Abstract: Recent defenses for safeguarding open-weight large language models (LLMs) are intended to prevent adversarial usage. Underlying these defenses is an ass

OpenAI announces partnerships to combat election misinformation, offering cybersecurity products to state officials and backing legislation to curb deepfakes (Maria Curi/Axios)

Maria Curi / Axios: OpenAI announces partnerships to combat election misinformation, offering cybersecurity products to state officials and backing legislation to curb deepfakes — OpenAI is announcing

safetytechmeme

Over-Alignment vs Over-Fitting: The Role of Feature Learning Strength in Generalization

arXiv:2602.00827v2 Announce Type: replace Abstract: Feature learning strength (FLS), i.e., the inverse of the effective output scaling of a model, plays a critical role in shaping the optimization dyn

Pair-In, Pair-Out: Latent Multi-Token Prediction for Efficient LLMs

arXiv:2605.27255v1 Announce Type: cross Abstract: Long chain-of-thought reasoning has made autoregressive decoding the dominant inference cost of modern large language models. Existing methods target

Palantir CEO Alex Karp goes after AI slop. The fight over AI “slop” is really a fight over whether software is performing or merely pretendi…

Palantir CEO Alex Karp goes after AI slop. The fight over AI “slop” is really a fight over whether software is performing or merely pretending. 'The appearance of software working is not software work

per comments from @GergelyOrosz below i don’t think these data are compelling after all, and am deleting the OP

Gary Marcus deleted an original post after Gergely Orosz provided comments questioning the compelling nature of the data presented. The post appears to have been withdrawn due to critical feedback tha

PICACO: Pluralistic In-Context Value Alignment of LLMs via Total Correlation Optimization

arXiv:2507.16679v3 Announce Type: replace-cross Abstract: In-Context Learning has shown great potential for aligning Large Language Models (LLMs) with human values, helping reduce harmful outputs and

Position: Machine Learning for Heart Transplant Allocation Policy Optimization Should Account for Incentives

arXiv:2602.04990v3 Announce Type: replace Abstract: The allocation of scarce donor organs constitutes one of the most consequential algorithmic challenges in healthcare. While the field is rapidly tra

Practical Anonymous Two-Party Gradient Boosting Decision Tree

arXiv:2605.26903v1 Announce Type: cross Abstract: Structured data is well handled by gradient-boosted decision trees (GBDT), which are usually trained on vertically partitioned features across mutuall

Provably Safe Motion Planning Under Unknown Disturbances

arXiv:2605.26625v1 Announce Type: new Abstract: We present a provably safe sampling-based motion planning algorithm for robotic systems affected by random disturbances of unknown distribution. We cons

safetyarxiv-cs-ro

PyCAT4: A Hierarchical Vision Transformer-based Framework for 3D Human Pose Estimation

arXiv:2508.02806v3 Announce Type: replace Abstract: Recently, a significant improvement in the accuracy of 3D human pose estimation has been achieved by combining convolutional neural networks (CNNs)

Quantized Keys Steal Attention: Bias Correction for KV-Cache Compression in Video Diffusion

arXiv:2605.26266v1 Announce Type: cross Abstract: Chunk-wise autoregressive video diffusion models rely on a KV cache of previously generated chunks to avoid redundant computation, but this cache quic

Real Images, Worse Judgments: Evaluating Vision-Language Models on Concreteness and Imagery

arXiv:2605.27315v1 Announce Type: new Abstract: Visual inputs are often assumed to improve language understanding in multimodal models. We examine this assumption by asking whether vision-language mod

safetyarxiv-cs-cl

ReasonOps: A Unified Operational Paradigm for Trustworthy Verified LLM Reasoning

arXiv:2605.27014v1 Announce Type: cross Abstract: Large Language Models (LLMs) have transformed artificial intelligence from primarily generative systems into increasingly capable reasoning agents. Re

Rethinking the Trust Region in LLM Reinforcement Learning

arXiv:2602.04879v2 Announce Type: replace-cross Abstract: Reinforcement learning (RL) has become a cornerstone for fine-tuning Large Language Models (LLMs), with Proximal Policy Optimization (PPO) ser

Rethinking Weakly-supervised Video Temporal Grounding From a Game Perspective

arXiv:2605.26441v1 Announce Type: cross Abstract: This paper addresses the challenging task of weakly-supervised video temporal grounding. Existing approaches are generally based on the moment proposa

RICE-PO: Turning Retrieval Interactions into Credit Signals for Reasoning Agents

arXiv:2605.26352v1 Announce Type: new Abstract: Retrieval is increasingly moving from one-shot matching toward interactive reasoning, where language agents iteratively inspect evidence, reformulate qu

safetyarxiv-cs-cl

Robust Koopman Control Barrier Filters for Safe Actor-Critic Reinforcement Learning

arXiv:2605.26452v1 Announce Type: cross Abstract: Safe reinforcement learning (RL) for robotic systems requires policies that improve task performance while satisfying state and input constraints duri

Sample Complexity of Policy Gradient for Log-Growth Control

arXiv:2605.26640v1 Announce Type: cross Abstract: We study the sample complexity of policy gradient for log-growth control -- the problem of learning, from observed state transitions, a feedback gain

Scaling World-Model Reinforcement Learning Through Diffusion Policy Optimization

arXiv:2605.26282v1 Announce Type: new Abstract: Model-based reinforcement learning (RL) can be effectively supported at scale through the use of world models. However, in practice, scaling such approa

SCENT: Aligning Mass Spectra with Molecular Structure for Olfactory Perception

arXiv:2605.27009v1 Announce Type: new Abstract: Predicting human olfactory perception from molecular structure has seen remarkable progress, yet these approaches require explicit chemical structure at

SCKAN: Structural Consensus-based KAN Prototype Learning for Semi-Supervised Pancreas Segmentation

arXiv:2605.27032v1 Announce Type: new Abstract: Accurate pancreas segmentation is critical for early cancer diagnosis, where annotation scarcity necessitates Semi-Supervised Learning (SSL). However, d

Securing Multi-Agent Systems Against Corruptions via Node Contribution Backpropagation

arXiv:2510.19420v2 Announce Type: replace-cross Abstract: Multi-Agent Systems (MAS) have become a prevalent paradigm for Large Language Model (LLM) applications. However, the complex multi-agent desig

Self-Improvement Imitation with Biologically Guided Search for Protein Design Under Oracle Budgets

arXiv:2605.26690v1 Announce Type: cross Abstract: Protein sequence optimization under tight oracle budgets requires methods that explore vast combinatorial spaces while making each evaluation informat

Semantic Robustness Probing via Inpainting: An Interactive Tool for Safety-Critical Object Detection

arXiv:2605.27155v1 Announce Type: cross Abstract: Testing object detectors in safety-critical domains requires semantically meaningful probes beyond pixel-level corruptions. We present SemProbe, a too

Signal-to-Noise Ratio and Sample Size Govern Representational Alignment in Neural Networks

arXiv:2605.26973v1 Announce Type: cross Abstract: Neural networks are known to develop latent representations that are aligned, namely structurally similar across networks trained with different archi

SketchAssist: A Practical Assistant for Semantic Edits and Precise Local Redrawing

arXiv:2512.14140v2 Announce Type: replace Abstract: Sketch editing requires jointly handling high-level semantic changes and precise local redrawing, a combination that is particularly challenging for

SL-BiLEM: Structured Learnable Behavior-in-the-Loop Epidemic Modeling for Forecasting and Policy Evaluation

arXiv:2605.26704v1 Announce Type: cross Abstract: Epidemic forecasting faces a fundamental challenge: human behavior dynamically responds to disease spread, creating feedback loops that induce distrib

some data i shared yesterday on anthropic revenue possibly slowing down aren’t as a compelling as i thought; i have deleted my posts and awa…

some data i shared yesterday on anthropic revenue possibly slowing down aren’t as a compelling as i thought; i have deleted my posts and await better data before drawing conclusions. h/t @GergelyOrosz

Spectral Principal Paths: A Spectral Perspective on Linear Representation Formation in LLMs

arXiv:2506.08543v3 Announce Type: replace Abstract: High-level representations have become a central focus in enhancing AI transparency and control, shifting attention from individual neurons or circu

Spend Your Rollouts Where It Counts: Rollout Allocation for Group-Based RL Post-Training

arXiv:2605.26606v1 Announce Type: cross Abstract: Reinforcement learning (RL) is the dominant paradigm for post-training large language models. However, in the online, on-policy setting, rollout gener

SQARL: A Size-Agnostic Reinforcement Learning approach for Circuit Allocation in Distributed Quantum Architectures

arXiv:2605.27027v1 Announce Type: new Abstract: The scaling of quantum processors is currently limited by technical challenges such as decoherence and cross-talk. As the number of qubits grows, interf