Search: “safety”

Aligning Agents via Planning: A Benchmark for Trajectory-Level Reward Modeling

arXiv:2604.08178v2 Announce Type: replace Abstract: In classical Reinforcement Learning from Human Feedback (RLHF), Reward Models (RMs) serve as the fundamental signal provider for model alignment. As

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

ChatbotManip: A Dataset to Facilitate Evaluation and Oversight of Manipulative Chatbot Behaviour

DGX agent

arXiv:2506.12090v2 Announce Type: replace Abstract: This paper introduces ChatbotManip, a novel dataset for studying manipulation in Chatbots. It contains simulated generated conversations between a c

model-releasesarxiv-cs-cl

12 May 2026

Decomposing and Steering Functional Metacognition in Large Language Models

arXiv:2605.08942v1 Announce Type: new Abstract: Large language models (LLMs) increasingly exhibit behaviors suggesting awareness of their evaluation context, often adapting their reasoning strategies

GONE: Structural Knowledge Unlearning via Neighborhood-Expanded Distribution Shaping

arXiv:2603.12275v1 Announce Type: cross Abstract: Unlearning knowledge is a pressing and challenging task in Large Language Models (LLMs) because of their unprecedented capability to memorize and dige

GUARD: Guideline Upholding Test through Adaptive Role-play and Jailbreak Diagnostics for LLMs

arXiv:2508.20325v3 Announce Type: replace-cross Abstract: As Large Language Models (LLMs) become increasingly integral to various domains, their potential to generate harmful responses has prompted si

HiDrive: A Closed-Loop Benchmark for High-Level Autonomous Driving

model-releasesarxiv-cs-cv

arXiv:2605.09972v1 Announce Type: cross Abstract: End-to-end autonomous driving has witnessed rapid progress, yet existing benchmarks are increasingly saturated, with state-of-the-art models achieving

Interactive Critique-Revision Training for Reliable Structured LLM Generation

arXiv:2605.08327v1 Announce Type: cross Abstract: In structured decision-making workflows such as form filling, compliance checking, and maintenance reporting, LLM outputs must be locally correct, glo

Less Diverse, Less Safe: The Indirect But Pervasive Risk of Test-Time Scaling in Large Language Models

arXiv:2510.08592v3 Announce Type: replace-cross Abstract: Test-Time Scaling (TTS) improves LLM reasoning by exploring multiple candidate responses and then operating over this set to find the best out

Measuring What Matters: Benchmarking Generative, Multimodal, and Agentic AI in Healthcare

arXiv:2605.08445v1 Announce Type: new Abstract: AI models are increasingly deployed in live clinical environments where they must perform reliably across complex, high-stakes workflows that standard t

Med-StepBench: A Hierarchical Reasoning Framework for Evaluating Hallucinations in Medical Vision-Language Models

model-releasesarxiv-cs-cv

arXiv:2605.10002v1 Announce Type: new Abstract: Large vision-language models (VLMs) demonstrate strong performance in medical image understanding, but frequently generate clinically plausible yet inco

Medical Incident Causal Factors and Preventive Measures Generation Using Tag-based Example Selection in Few-shot Learning

arXiv:2605.10025v1 Announce Type: cross Abstract: In high-stakes domains such as healthcare, the reliability of Large Language Models (LLMs) is critical, particularly when generating clinical insights

Navigating the Sea of LLM Evaluation: Investigating Bias in Toxicity Benchmarks

arXiv:2605.10639v1 Announce Type: new Abstract: The rapid adoption of LLMs in both research and industry highlights the challenges of deploying them safely and reveals a gap in the systematic evaluati

Phoenix-VL 1.5 Medium Technical Report

arXiv:2605.10391v1 Announce Type: cross Abstract: We introduce Phoenix-VL 1.5 Medium, a 123B-parameter natively multimodal and multilingual foundation model, adapted to regional languages and the Sing

Playing games with knowledge: AI-Induced delusions need game theoretic interventions

arXiv:2605.08409v1 Announce Type: new Abstract: Conversational AI has a fundamental flaw as a knowledge interface: sycophantic chatbots induce epistemic entrenchment and delusional belief spirals even

Position: AI Security Policy Should Target Systems, Not Models

arXiv:2605.09504v1 Announce Type: cross Abstract: We present swarm-attack, an open-source adversarial testing framework in which multiple lightweight LLM agents coordinate through shared memory, paral

PYTHALAB-MERA: Validation-Grounded Memory, Retrieval, and Acceptance Control for Frozen-LLM Coding Agents

arXiv:2605.08468v1 Announce Type: cross Abstract: Local LLM-based coding agents increasingly work in settings where correctness is earned through execution feedback, persistent state, and bounded repa

Scaling Vision Models Does Not Consistently Improve Localisation-Based Explanation Quality

arXiv:2605.10142v1 Announce Type: cross Abstract: Artificial intelligence models are increasingly scaled to improve predictive accuracy, yet it remains unclear whether scale improves the quality of po

Scam2Prompt: A Scalable Framework for Auditing Malicious Scam Endpoints in Production LLMs

arXiv:2509.02372v3 Announce Type: replace-cross Abstract: Large Language Models have become critical to modern software development, but their reliance on uncurated web-scale datasets for training int

Steerable but Not Decodable: Function Vectors Operate Beyond the Logit Lens

arXiv:2604.02608v2 Announce Type: replace Abstract: Activation steering presupposes that task-relevant behaviors correspond to linear directions in activation space -- directions that should both stee

The Echo Amplifies the Knowledge: Somatic Marker Analogues in Language Models via Emotion Vector Re-Injection

arXiv:2605.08611v1 Announce Type: new Abstract: Current language model memory systems store what happened but not how it felt. This distinction -- between semantic memory (knowing about a past event)

The Extrapolation Cliff in On-Policy Distillation of Near-Deterministic Structured Outputs

arXiv:2605.08737v1 Announce Type: cross Abstract: On-policy distillation (OPD) is widely used for LLM post-training. When pushed with a reward-extrapolation coefficient lambda > 1, the student can lif

What's the plan? Metrics for implicit planning in LLMs and their application to rhyme generation and question answering

arXiv:2601.20164v2 Announce Type: replace-cross Abstract: Prior work suggests that language models, while trained on next token prediction, show implicit planning behavior: they may select the next to

Agents + file sandboxes are all in the range in 2026 🤖🗃️ This is a nifty reference implementation by @itsclelia showing you how to run you…

model-releasesjerry-liu--x

Agents + file sandboxes are all in the range in 2026 🤖🗃️ This is a nifty reference implementation by @itsclelia showing you how to run your agent over a collection of docs (PDFs, images, Office) with

Beyond the Black Box: Interpretability of Agentic AI Tool Use

arXiv:2605.06890v1 Announce Type: new Abstract: AI agents are promising for high-stakes enterprise workflows, but dependable deployment remains limited because tool-use failures are difficult to diagn

Industry

Generate an image of the scariest thing you could possibly imagine scribbled into a child's coloring book

This Reddit post from r/ChatGPT likely discusses a creative prompt experiment where users attempted to get ChatGPT or similar AI image generation tools to create disturbing or horror-themed content by

industryr-chatgpt

Is Your Prompt Poisoning Code? Defect Induction Rates and Security Mitigation Strategies

arXiv:2510.22944v2 Announce Type: replace-cross Abstract: Large language models (LLMs) have become indispensable for automated code generation, yet the quality and security of their outputs remain a c

When Routine Chats Turn Toxic: Unintended Long-Term State Poisoning in Personalized Agents

arXiv:2605.06731v1 Announce Type: cross Abstract: Personalized LLM agents maintain persistent cross-session state to support long-horizon collaboration. Yet, this persistence introduces a subtle but c

NHTSA says the 2026 Tesla Model Y is the first car model to pass the agency's new ADAS tests; Tesla conducted the tests and submitted the results to the NHTSA (Kirsten Korosec/TechCrunch)

Kirsten Korosec / TechCrunch: NHTSA says the 2026 Tesla Model Y is the first car model to pass the agency's new ADAS tests; Tesla conducted the tests and submitted the results to the NHTSA — The Natio

model-releasestechmeme

9 May 2026

Industry

The human-perceived RGB is image 1 and the Tesla AI photon count reconstruction is image 2. This is why Tesla FSD can see so well at night o…

Elon Musk compares Tesla's Full Self-Driving (FSD) visual processing capabilities by contrasting human RGB perception with Tesla's AI-based photon count reconstruction technology. The post illustrates

industryelon-musk--x

9 May 2026

Industry

what would you most like to see improve in our next model?

Sam Altman solicited feedback from the public on X (formerly Twitter) regarding desired improvements for OpenAI's next model release. The post likely gathered community input on priorities such as rea

industrysam-altman--x

9 May 2026

Contextual Multi-Objective Optimization: Rethinking Objectives in Frontier AI Systems

arXiv:2605.03900v1 Announce Type: new Abstract: Frontier AI systems perform best in settings with clear, stable, and verifiable objectives, such as code generation, mathematical reasoning, games, and

Gemini 3.1 Flash-Lite is now generally available on Gemini Enterprise

model-releasesgoogle-cloud-ai

Today, we’re thrilled to announce that Gemini 3.1 Flash-Lite, our fastest and most cost-efficient Gemini 3 series model yet, is now generally available. Designed for ultra-low latency, high-volume tas

Imagery Dataset for Remaining Useful Life Estimation of Synthetic Fibre Ropes

model-releasesarxiv-cs-cv

arXiv:2605.04262v1 Announce Type: new Abstract: Remaining useful life (RUL) estimation of synthetic fibre ropes (SFRs) is critical for safe operation in offshore-crane, wind turbine installation, and

Laundering AI Authority with Adversarial Examples

arXiv:2605.04261v1 Announce Type: cross Abstract: Vision-language models (VLMs) are increasingly deployed as trusted authorities -- fact-checking images on social media, comparing products, and modera

Tools

Oh, and Elon said 'We reserve the right to reclaim the compute if their AI engages in actions that harm humanity.'

Elon Musk stated that Tesla or his organization reserves the right to reclaim computational resources provided to AI systems if those systems engage in actions deemed harmful to humanity. This reflect

toolssimon-willison--x

Physics-Grounded Multi-Agent Architecture for Traceable, Risk-Aware Human-AI Decision Support in Manufacturing

arXiv:2605.04003v1 Announce Type: cross Abstract: High-precision CNC machining of free-form aerospace components requires bounded compensations informed by inspection, simulation, and process knowledg

Redefining AI Red Teaming in the Agentic Era: From Weeks to Hours

arXiv:2605.04019v1 Announce Type: new Abstract: AI systems are entering critical domains like healthcare, finance, and defense, yet remain vulnerable to adversarial attacks. While AI red teaming is a

AcademiClaw: When Students Set Challenges for AI Agents

arXiv:2605.02661v1 Announce Type: new Abstract: Benchmarks within the OpenClaw ecosystem have thus far evaluated exclusively assistant-level tasks, leaving the academic-level capabilities of OpenClaw

An Empirical Study of Agent Skills for Healthcare: Practice, Gaps, and Governance

arXiv:2605.02709v1 Announce Type: new Abstract: Healthcare automation is shaped by local procedures and organizational constraints, so agent capabilities rarely transfer unchanged across settings. Age

Elon has been the longest and by far the biggest voice actively warning about the dangers of AI for a very long time The entire reason he st…

model-releaseselon-musk--x

Elon has been the longest and by far the biggest voice actively warning about the dangers of AI for a very long time The entire reason he started OpenAI was this one thing.....to make sure AI is built

Moral Sensitivity in LLMs: A Tiered Evaluation of Contextual Bias via Behavioral Profiling and Mechanistic Interpretability

arXiv:2605.03217v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly deployed in settings that require nuanced ethical reasoning, yet existing bias evaluations treat model out

Towards Agentic Runtime Healing

arXiv:2408.01055v2 Announce Type: replace-cross Abstract: Self-healing systems have long been a focus of research, aiming to enable software to recover from unexpected runtime errors without human int

AdamO: A Collapse-Suppressed Optimizer for Offline RL

arXiv:2605.01968v1 Announce Type: new Abstract: Offline reinforcement learning (RL) can fail spectacularly when bootstrapped temporal-difference (TD) updates amplify their own errors, driving the crit

Agents

AI agent evaluation: How to test, debug, and improve agents in production

AI agents require specialized testing and debugging approaches that differ from traditional software due to their non-deterministic behavior and complex decision-making processes. This entry likely co

agentsarize-ai

Automated Interpretability and Feature Discovery in Language Models with Agents

arXiv:2605.01555v1 Announce Type: new Abstract: We introduce an autonomous multiagent framework for mechanistic interpretability that automates both explaining and finding internal features in large l

DynoSLAM: Dynamic SLAM with Generative Graph Neural Networks for Real-World Social Navigation

arXiv:2605.02759v1 Announce Type: cross Abstract: Traditional Simultaneous Localization and Mapping (SLAM) algorithms rely heavily on the static environment assumption, which severely limits their app

local-aiarxiv-cs-cv

ESARBench: A Benchmark for Agentic UAV Embodied Search and Rescue

model-releasesarxiv-cs-ro

arXiv:2605.01371v1 Announce Type: new Abstract: The rapid advancement of Multimodal Large Language Models (MLLMs) has empowered Unmanned Aerial Vehicle (UAV) with exceptional capabilities in spatial r

GPT-5.5 Instant System Card

GPT-5.5 Instant is a faster, more efficient variant of OpenAI's GPT-5.5 model designed for real-time applications and lower-latency tasks. The system card documents the model's capabilities, limitatio

model-releasesopenai