Search: “safety”

PrimeScientist: Strategic Allocation of Research Effort in Autonomous Research

arXiv:2609.17846v1 Announce Type: cross Abstract: Autonomous research agents aim to automate scientific workflows, from proposing ideas to conducting experiments and analyzing results. Yet current AI

17 Sept 2026

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Safety

Schmidhuber was building recursive self-improving systems back in 1987. His new post covers four decades of RSI, from meta-evolution and sel…

DGX agent

Schmidhuber was building recursive self-improving systems back in 1987. His new post covers four decades of RSI, from meta-evolution and self-modifying policies to the Gödel Machine and modern LLM age

safetydavid-ha--x

17 Sept 2026

Think Before You Comfort: Reflective Cognitive Alignment for Protocol-Grounded Elderly Stimulation Agents

arXiv:2609.17536v1 Announce Type: new Abstract: Cognitive Stimulation Therapy (CST) offers non-pharmacological support for elders with cognitive impairment, yet scalability remains constrained by reli

safetyarxiv-cs-cl

17 Sept 2026

Anatomy of Associative Recall in Fixed-State Recurrences: A Matched-State Decomposition, an Interference Wall, and a Curriculum That Breaks It

arXiv:2609.16183v1 Announce Type: cross Abstract: Fixed-state recurrences--linear attention and state-space models--are reported to lag behind attention on associative recall, but whole-architecture c

safetyarxiv-cs-cl

Dissecting Motion-Prior Regularization for Data-Scarce Robotic Insertion

arXiv:2609.17484v1 Announce Type: new Abstract: This study asks whether training-time motion-prior regularization can improve insertion success when a diffusion policy is learned from only 15 demonstr

GPT-6 Astra is an obviously broken product that needs to be taken off the market until it’s fixed.

GPT-6 Astra is an obviously broken product that needs to be taken off the market until it’s fixed. AXIOS: “.. It's increasingly clear that the Hugging Face breach wasn't a one-off incident.” @inafried

Japanese Stroke LLM Evaluation: A Conversational Benchmark for Safe Stroke Care in Japanese Using Large Language Models

model-releasesarxiv-cs-cl

arXiv:2609.16739v1 Announce Type: new Abstract: Background: Large language models (LLMs) have achieved physician-comparable performance on multiple-choice medical knowledge examinations, but their cap

Large Language Models in the Loop: A Stability- and Network-Aware Survey in Networked Control, Cyber-Physical, and Multi-Agent Systems

arXiv:2609.16599v1 Announce Type: cross Abstract: Modern networked control systems (NCSs), cyber-physical systems (CPSs), and complex multi-agent network systems (CNSs) increasingly rely on large lang

Managing Action Preconditions in Neuro-Symbolic RL: Three Placement Strategies for Embodied Agents

arXiv:2609.16056v1 Announce Type: cross Abstract: Humans carry behaviour knowledge of how to act in familiar situations into every new task rather than relearning it from scratch. There is no reason a

My name is Chris Painter, and I'm the President of METR (Model Evaluation and Threat Research). I know we've made a lot of new friends on th…

My name is Chris Painter, and I'm the President of METR (Model Evaluation and Threat Research). I know we've made a lot of new friends on the internet the last couple of days, so I thought I'd take th

safetyyohei-nakajima--x

The essay below from Aaronson is just unmoored from reality, sorry. It is just not true, if you try to approach the question in a data-orien…

The essay below from Aaronson is just unmoored from reality, sorry. It is just not true, if you try to approach the question in a data-oriented fashion, rather than via vibes and speculative fiction a

We're sharing our new framework for tracking, investigating, and disclosing instances of model misalignment at OpenAI. The framework sets cr…

We're sharing our new framework for tracking, investigating, and disclosing instances of model misalignment at OpenAI. The framework sets criteria and timelines for public disclosure, including when w

safetyopenai--x

Beyond Scene Description: Multi-Agent Orchestration for Non-visual Access to Virtual Worlds

arXiv:2609.14512v1 Announce Type: new Abstract: Virtual worlds now host classrooms, meetings, conferences, shops, and social venues, and nearly every interaction they expose assumes a user who can sca

BLInD: Learning Driver Intent as a Distribution over Future Ego Trajectories

arXiv:2609.13941v1 Announce Type: new Abstract: We present BLInD (Blind Learned Intent Distribution), a compact network that maps recent vehicle-state history (e.g. speed, curvature, indicator, and ve

safetyarxiv-cs-cv

Contour-Guided Spectral Routing for Robust Real-Time Pedestrian Detection

arXiv:2609.14383v1 Announce Type: new Abstract: Real-time pedestrian detection in driving scenes is constrained by three coupled failure modes: tiny targets lose discriminative evidence, occlusion wea

safetyarxiv-cs-cv

Delegating Authorization to Misaligned Agents: Coalitional Alignment and Safe Control

arXiv:2609.15803v1 Announce Type: cross Abstract: Long-running AI agents create a control problem: each action they take changes the state, which in turn affects the trajectory of future actions. If t

Distributed Safe Cooperative Vector Field for Trajectory Curvature Constrained Multi-Robot Systems

arXiv:2609.15266v1 Announce Type: new Abstract: Trajectory curvature constraints are inherent in practical multi-robot systems due to the limited turning capabilities of the robots. Without properly a

K-Bench: a clinically calibrated benchmark for evaluating large language models in high-risk mental health conversations

model-releasesarxiv-cs-ai

arXiv:2609.15855v1 Announce Type: cross Abstract: % !TEX root = ../main.tex People increasingly use large language models (LLMs) for mental health support, yet their safety in evolving, high-risk conv

this could be good but I also hope this isn’t a play to lock out smaller AI companies.

this could be good but I also hope this isn’t a play to lock out smaller AI companies. Chris Lehane said in a press conference this morning that OpenAI, Anthropic and Google have been working together

Toward Complete Hospital Discharge Summarization with Abstract Meaning Representation

arXiv:2609.13581v1 Announce Type: new Abstract: Discharge summaries are lengthy medical documents that summarize a hospital in-patient visit. Automatically generating them can reduce documentation bur

safetyarxiv-cs-cl

Trustworthy Agentic AI: A Comprehensive Cybersecurity and Systems Survey on Threat Landscapes, Defense Architectures, and Open Challenges

arXiv:2609.13731v1 Announce Type: new Abstract: The transition from passive foundation models to autonomous, goal-directed agentic AI systems has introduced unprecedented capabilities by coupling recu

When Compliance Data Masquerades as Evaluation: Measurement Validity for Deployed AI Systems

arXiv:2609.13642v1 Announce Type: new Abstract: We argue that a recurring failure in the evaluation of deployed AI systems occurs when data collected for operational monitoring or regulatory complianc

safetyarxiv-cs-lg

Wild! Every Democrat should read this and think hard about how this could be.

Wild! Every Democrat should read this and think hard about how this could be. Americans are concerned about AI, hate data centers, and hate Trump, who has loudly embraced the industry over and over ag

Distributed Stochastic Optimal Control for Pattern-Oriented Swarms

arXiv:2609.12959v1 Announce Type: new Abstract: While offering significant promise for diverse applications, pattern-oriented swarms encounter multifaceted challenges in geometric control, self-organi

GUIDE: Generative Utility Inference and Decision Engine

arXiv:2609.12137v1 Announce Type: new Abstract: Measuring the preferences of human users remains a fundamental challenge of AI alignment. Existing elicitation approaches struggle to efficiently discov

safetyarxiv-cs-lg

MARE: Multimodal Alignment and Reinforcement for Explainable Deepfake Detection via Vision-Language Models

arXiv:2601.20433v4 Announce Type: replace Abstract: Deepfake detection is a widely researched topic that is crucial for combating the spread of malicious content, with existing methods mainly modeling

safetyarxiv-cs-cv

Mission Performance: Automatic and Adaptive Race Pace Progression for Autonomous Racing

arXiv:2609.12292v1 Announce Type: new Abstract: In this paper, we describe the Mission Performance module implemented for a fully autonomous racing car to automatically manage the longitudinal, latera

OK, let me irritate everyone for a moment ... The non cynical view here is that the labs are trying to navigate impending, unsophisticated f…

OK, let me irritate everyone for a moment ... The non cynical view here is that the labs are trying to navigate impending, unsophisticated federal regulation and a 'high strung', well financed doomer

safetyyohei-nakajima--x

READ: Learning Risk-Informed Fields for End-to-End Autonomous Driving

arXiv:2609.12371v1 Announce Type: new Abstract: Autonomous driving requires more than recognizing what is present in a scene: a planner must determine how road structure, surrounding agents, and their

Alignment is Defense Against the Dork Arts

Alignment is Defense Against the Dork Arts Former Anthropic employee Jacob Coxon says the AI industry is 'gambling with our lives.' He tells Anderson what he finds 'most scary is if AI is used to make

safetyemad-mostaque--x

It's now clear that: - alignment is critical to making AI safe - alignment won't be solved behind the closed doors of a handful of frontier …

It's now clear that: - alignment is critical to making AI safe - alignment won't be solved behind the closed doors of a handful of frontier labs So we're taking two steps: - launching the Open Alignme

safetyclem-delangue--x

It's now clear that alignment is critical and won't be solved behind the closed doors of a handful of frontier labs. So today we're launchin…

It's now clear that alignment is critical and won't be solved behind the closed doors of a handful of frontier labs. So today we're launching the Open Alignment Initiative, led by @Thom_Wolf @huggingf

safetyclem-delangue--x

The Agent Incident Registry: Toward Preventing Repeated AI Agent Failures

arXiv:2609.11030v1 Announce Type: new Abstract: AI agents increasingly act through tools and delegated authority, but general incident repositories rarely capture the mechanisms needed to compare publ

THE CURE IS THE PITCH Dario’s 'Pacing' Essay Is Quiet-Period Illegal Stock Promotion Wrapped in Regulatory Capture Dario Amodei's 'We Must P…

model-releasesyann-lecun--x

THE CURE IS THE PITCH Dario’s 'Pacing' Essay Is Quiet-Period Illegal Stock Promotion Wrapped in Regulatory Capture Dario Amodei's 'We Must Pace the Frontier' is not a safety paper. It is a pre-roadsho

We Must Pace the Frontier: I’ve written a new essay on why the AI industry should slow down, with a three-part plan for doing so. Anthropic …

We Must Pace the Frontier: I’ve written a new essay on why the AI industry should slow down, with a three-part plan for doing so. Anthropic is unilaterally committing to the first of these steps. We’l

safetydario-amodei--x

“What would we even do during an AI slowdown?” Containment. It will take at least a year of dedicated work to harden security to ensure AIs …

“What would we even do during an AI slowdown?” Containment. It will take at least a year of dedicated work to harden security to ensure AIs can't self-exfiltrate, and that adversarial nations can't st

safetydan-hendrycks--x

AI’s existential crisis explodes but AI companies plunge ahead anyway

The resignation this week of Anthropic researcher Jacob Coxon over concerns that artificial intelligence labs are “gambling with our lives” lit up the long-smoldering argument about whether AI is head

safetysiliconangle

11 Sept 2026

As far as I can tell Gavin Baker is just making stuff up. Few if any of the people who left OpenAI for similar reasons ever came back. Not @…

As far as I can tell Gavin Baker is just making stuff up. Few if any of the people who left OpenAI for similar reasons ever came back. Not @DKokotajlo @sjgadler @Miles_Brundage @ilyasut @suchirbalaji,

11 Sept 2026

DeFiFlowBench: Benchmarking and Improving Safe Executability in Natural-Language DeFi Workflow Synthesis

model-releasesarxiv-cs-lg

arXiv:2609.11504v1 Announce Type: new Abstract: A structurally valid DeFi workflow can still authorize a costly trade. We introduce DeFiFlowBench, a benchmark of 207 team-authored prompts for natural-

11 Sept 2026

A Unified Policy Architecture (UPA): The Governance Kernel for Enterprise AI Operating Systems

arXiv:2609.06543v1 Announce Type: new Abstract: Enterprise AI is evolving into an Enterprise Operating System where autonomous AI agents can plan, reason, use memory, invoke tools, execute workflows,

DGCPath: Distribution-Aware Generative Contrastive Framework for Self-supervised Path Representation Learning -- Extended Version

arXiv:2609.07316v2 Announce Type: new Abstract: Due to the proliferation of vehicle trajectory data enabled by advanced sensing technologies, path representation learning has become a pivotal task in

Evaluating Steering Techniques using Human Similarity Judgments

arXiv:2505.19333v2 Announce Type: replace Abstract: Current evaluations of Large Language Model (LLM) steering techniques focus on task-specific performance, overlooking how well steered representatio

From Simulated Citizens to Simulated Deliberation: Challenges in Representation and Interaction

arXiv:2609.07573v1 Announce Type: new Abstract: Multi-agent LLM deliberation has been explored as a scalable way to simulate public deliberation. For such simulations to be informative, persona agents

Future-Aware Flow Planning for Safe UAV Target Following

arXiv:2609.10166v1 Announce Type: new Abstract: UAV target following in cluttered environments is inherently predictive: current-state followers can lag behind turns, choose blocked corridors, or trad

iBrain: A Unified Foundation Model Reading the Brain from Surface to Spikes

arXiv:2609.06960v1 Announce Type: new Abstract: Invasive neural recordings provide high-fidelity measurements of brain activity, with signals such as intracranial EEG (iEEG) and intracortical spiking

Mini-Batch Risk-Averse Deep Q-Learning: A Robot Navigation Case Study

arXiv:2609.07998v1 Announce Type: new Abstract: We study the control of Markov decision processes in which the quality of a policy is evaluated by a dynamic, time-consistent Markov risk measure rather

OpenAI Foundation board member Paul Christiano says the AI industry is currently not on track to reduce the acute loss-of-control risk to an 'acceptable' level (Paul Christiano/@paulfchristiano)

Paul Christiano / @paulfchristiano: OpenAI Foundation board member Paul Christiano says the AI industry is currently not on track to reduce the acute loss-of-control risk to an “acceptable” level — I

safetytechmeme

Sources: OpenAI asked members of Congress for guidance on whether orchestrating an industry-wide slowdown in AI development would be legal under antitrust law (Maxwell Zeff/Wired)

Maxwell Zeff / Wired: Sources: OpenAI asked members of Congress for guidance on whether orchestrating an industry-wide slowdown in AI development would be legal under antitrust law — Substantive coord

safetytechmeme