Search: “safety”

A Benchmark for Evaluating Outcome-Driven Constraint Violations in Autonomous AI Agents

arXiv:2512.20798v4 Announce Type: replace Abstract: As autonomous AI agents are deployed in high-stakes environments, ensuring their safety has become a paramount concern. Existing safety benchmarks p

15 Apr 2026

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Safety

Efficient Disruption of Criminal Networks through Multi-Objective Genetic Algorithms

DGX agent

arXiv:2604.09647v1 Announce Type: cross Abstract: Criminal networks, such as the Sicilian Mafia, pose substantial threats to public safety, national security, and economic stability. Outdated disrupti

safetyarxiv-cs-ai

14 Apr 2026

RoboStereo: Dual-Tower 4D Embodied World Models for Unified Policy Optimization

arXiv:2603.12639v2 Announce Type: replace Abstract: Scalable Embodied AI faces fundamental constraints due to prohibitive costs and safety risks of real-world interaction. While Embodied World Models

14 Apr 2026

Designing Safe and Accountable GenAI as a Learning Companion with Women Banned from Formal Education

arXiv:2604.07253v1 Announce Type: cross Abstract: In gender-restrictive and surveilled contexts, where access to formal education may be restricted for women, pursuing education involves safety and pr

10 Apr 2026

Explainable AI to Improve Machine Learning Reliability for Industrial Cyber-Physical Systems

arXiv:2601.16074v2 Announce Type: replace Abstract: Industrial Cyber-Physical Systems (CPS) are sensitive infrastructure from both safety and economics perspectives, making their reliability criticall

10 Apr 2026

Leveraging Wireless Sensor Networks for Real-Time Monitoring and Control of Industrial Environments

arXiv:2510.13820v3 Announce Type: replace-cross Abstract: This research proposes an extensive technique for monitoring and controlling the industrial parameters using Internet of Things (IoT) technolo

10 Apr 2026

ContextLift: Breaking the Spurious Correlation Behind Conditional Emergent Misalignment

arXiv:2610.21633v1 Announce Type: new Abstract: Finetuning a language model on narrowly misaligned data can make it broadly misaligned. Interleaving generic safety data is the most effective known in-

safetyarxiv-cs-cl

16 Oct 2026

SCARCE: Emergent Institutions in Long-Horizon Multi-Agent Coding Systems

arXiv:2610.21029v1 Announce Type: cross Abstract: As autonomous agents become widely deployed, coordinating access to shared computing resources and services will become increasingly important. Recent

16 Oct 2026

What do AI chatbots do after users decline therapeutic redirection for suicide thoughts?

arXiv:2610.21253v1 Announce Type: cross Abstract: Safety evaluations of artificial intelligence (AI) chatbots focus on therapeutic redirection, statements urging users who disclose suicide thoughts to

16 Oct 2026

LLM Alignment--Utility Asymmetry under Semantic-Preserving Transformations

arXiv:2609.32717v2 Announce Type: replace-cross Abstract: Large Language Model (LLM) alignment is intended to ensure that models remain helpful and safe, but its stability under input distributional s

Moral Combat: Exploiting Moral Foundations Theory to Jailbreak LLMs

arXiv:2610.19587v1 Announce Type: new Abstract: Social psychology has long described how people can be persuaded to interpret a harmful act as moral. Recent research suggests that Large Language Model

safetyarxiv-cs-cl

REPRO: Reflective Evolutionary Prompt Optimizer for Automated LLM Red-Teaming

arXiv:2610.15513v1 Announce Type: cross Abstract: Safety-aligned large language models (LLMs) remain vulnerable to adversarial prompts that bypass their safety training. Existing automated red-teaming

Self-Evolving Agent Harness

arXiv:2610.18813v1 Announce Type: new Abstract: Harness self-evolution revises an agent's software scaffolding, including prompts, memory, workflows, and executable components, while keeping model wei

CoSMO: Conformal Semantic Mapping for Open-World Safe Robot Navigation

arXiv:2610.18321v1 Announce Type: new Abstract: Safe autonomous navigation requires not only geometric obstacle avoidance but also semantic awareness. Different object categories demand different safe

14 Oct 2026

Unfair and Unsafe: Everyday Bias Triggers Emergent Misalignment

arXiv:2610.15961v1 Announce Type: cross Abstract: Emergent misalignment (EM) occurs when fine-tuning a language model to a narrow task makes it misaligned on unrelated ones. Because organizations now

14 Oct 2026

Tracing and Taming Hallucinated Terms via Subsequence-Association Filtering and Breadth-Aware Selection for LLM Query Expansion

arXiv:2610.13810v1 Announce Type: cross Abstract: Large language models (LLMs) are now a standard source of query expansion terms but they hallucinate. They inject non existent entities and off-topic

safetyarxiv-cs-cl

12 Oct 2026

PatchBench: Measuring Collateral Damage in Activation Patching

model-releasesarxiv-cs-cl

arXiv:2610.10276v1 Announce Type: cross Abstract: An LLM safety patch can pass a benchmark while still being a poor repair. This risk is especially acute for jailbreak repairs, where the goal is to co

8 Oct 2026

Explainable Failure Prediction and Prevention in Maritime

arXiv:2610.08363v1 Announce Type: new Abstract: Maritime systems operate in highly dynamic environments where unexpected equipment failures can compromise safety, reliability, and operational efficien

Harmful SFT Leaves a Continuous Trace in LLM Checkpoint Updates

arXiv:2610.07518v1 Announce Type: cross Abstract: Safety auditing of post-trained large language models typically relies on model behavior, requiring model execution and depending on the coverage of a

Interleaved Projected Gradient Descent for Safe Imitation Learning

arXiv:2610.07167v1 Announce Type: cross Abstract: We propose an imitation-learning design for neural-network control policies under state and input constraints. Training alternates a standard imitatio

Jailbreaking Open-Weight LLMs via Random Embedding Perturbations

arXiv:2610.07125v1 Announce Type: cross Abstract: While open-weight models have enjoyed steady progress in capabilities and wide adoption across multiple domains, their safety remains an important con

Modeling Latent Disturbances for Robust Decision-Making in World Models

arXiv:2610.07599v1 Announce Type: cross Abstract: In this paper, we study robust decision-making in the latent space of world models (WMs). Robust optimization is a mathematical framework where, given

Risk-Sensitive Crowd Navigation with Adaptive Ellipsoidal Conformal Prediction

arXiv:2610.07474v1 Announce Type: new Abstract: Safe crowd navigation under distribution shift requires uncertainty representations that capture structured human-motion prediction errors and safety ob

End-to-End Safe Social Navigation via Multi-Task Reinforcement Learning and Probabilistic Perception

arXiv:2610.05733v1 Announce Type: new Abstract: Autonomous social navigation requires balancing efficiency, physical safety, and social compliance. Reinforcement Learning (RL) methods provide a viable

From Transformers to Weighted Automata: Towards the Verification of Large Language Models

arXiv:2610.04569v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly deployed in safety-critical settings, yet their black-box nature makes it difficult to provide formal gu

Harmful Content Generation in Text-to-Image Models: Capabilities and Moderation Limitations

arXiv:2610.06503v1 Announce Type: new Abstract: Text-to-image generative models can produce highly realistic imagery but also raise concerns about harmful misuse. While safety mechanisms exist, system

Least Restrictive Hyperplane Control Barrier Functions

arXiv:2510.18643v3 Announce Type: replace Abstract: Control Barrier Functions (CBFs) can provide provable safety guarantees for dynamic systems. However, finding a valid CBF for a system of interest i

Structured Representation Learning for Behavior Cloning: How can we learn to safely control a nuclear power plant?

arXiv:2610.06211v1 Announce Type: new Abstract: Learned models for industrial control are usually judged by aggregate accuracy, but accuracy at the component level does not guarantee safety once it is

Towards Safer Autonomous Driving in an Open World: A Dual-Process Approach

arXiv:2610.04088v1 Announce Type: cross Abstract: Before autonomous driving systems can be deployed on public roads, it is vital that these systems comply with safety standards, traffic rules, and soc

Filter-Aware Fine-Tuning for Safe Humanoid Whole-Body Tracking

arXiv:2610.02341v1 Announce Type: new Abstract: Safe whole-body motion is essential for deploying humanoid robots in unstructured environments. Modern humanoid control commonly separates reference spe

5 Oct 2026

Safe Streaming Flow Planning by Aligning Sampling Dynamics with Execution Dynamics

arXiv:2610.03132v1 Announce Type: cross Abstract: Generative planners based on diffusion/flow matching can learn to synthesize long-horizon trajectories from demonstrations. However, real-world deploy

5 Oct 2026

A Deterministic and Auditable AI Security Risk Assessment Framework with ATLAS Aligned Executable Rules and Formal Verification

arXiv:2610.01436v1 Announce Type: new Abstract: Artificial intelligence systems are increasingly deployed in high impact and safety critical settings, yet security assessment remains difficult to repr

Evaluating Physical Consistency and Plausibility in Generative Scenario Models for Autonomous Driving

arXiv:2610.01581v1 Announce Type: new Abstract: Generative AI models are increasingly used for scenario generation in autonomous driving. While they can generate realistic-looking scenarios, they ofte

Optimal Transport Reweighting for Robust Learning under Spurious Correlations and Label Noise

arXiv:2610.01028v1 Announce Type: cross Abstract: Machine learning models often suffer performance degradation under subpopulation shift, particularly when spurious correlations cause models to rely o

Skin-Deep: A Geometric Diagnostic for Alignment Fragility in Large Language Model Representations

arXiv:2606.22676v2 Announce Type: replace Abstract: Refusal on a safety benchmark does not reveal how stable that behavior will remain after model updates. Benign downstream fine-tuning can weaken ref

A Competing-Hazards Systematization of Loss of Control in Autonomous Agents

arXiv:2609.38411v1 Announce Type: new Abstract: Leading AI developers have reported agents acting beyond their approved limits, which a United Nations panel described as an early warning of loss of hu

CRAFT: Causal Responsibility and Failure Tracing in Medical Vision Language Models

arXiv:2609.38810v1 Announce Type: cross Abstract: As vision language models are increasingly deployed in clinical diagnosis, understanding how they internally resolve competing visual and textual sign

Improving OCR Faithfulness via Gated and Attenuated On-Policy Distillation

arXiv:2609.38282v1 Announce Type: new Abstract: Vision-language models may rewrite anomalous text in images into linguistically plausible expressions, compromising OCR transcription faithfulness. Sequ

Semantic Misalignment in Vision-Language Models under Perceptual Degradation

arXiv:2601.08355v3 Announce Type: replace Abstract: Vision-Language Models (VLMs) are increasingly deployed in autonomous driving and embodied AI systems, where reliable perception is critical for saf

Soft yet Effective Robots via Holistic Co-Design

arXiv:2505.03761v2 Announce Type: replace Abstract: Soft robots promise inherent safety via their material compliance for seamless interactions with humans or delicate environments. Despite progress,

30 Sept 2026

ThinkingGuard: Decoding Implicit Hazards via Step-by-Step Risk Attribution in Multimodal Large Language Models

arXiv:2609.36562v1 Announce Type: cross Abstract: While Multimodal Large Language Models (MLLMs) are increasingly deployed in safety-critical domains, their reliability is threatened by multimodal imp

30 Sept 2026

Weeding Out Bad Seeds: Initial-Noise-Robust Unlearning for Text-to-Image Diffusion Models

arXiv:2609.37537v1 Announce Type: new Abstract: Machine unlearning has emerged as a critical post-hoc safety measure to erase sensitive concepts from Text-to-Image (T2I) models without prohibitive ret

30 Sept 2026

Beyond Retrieval Relevance: Scene-Grounded Risk Entailment for Vision-Language Driving

arXiv:2609.34145v1 Announce Type: new Abstract: Retrieval-augmented generation (RAG) gives vision--language driving systems access to external safety knowledge, yet a retrieved risk rule may be releva

29 Sept 2026

COGNIT-Guard: Calibrated Standalone Direct-Decision Guardrails with Heterogeneous CPU-NPU Confidence Cascading under Explicit Latency and False-Positive Constraints

arXiv:2609.33671v1 Announce Type: cross Abstract: When must a foundation-model safety gateway generate tokens, and when should it directly output a calibrated decision? We study calibrated standalone

29 Sept 2026

Fading Expert Guidance: Bridging Model-Based and Learning-Based Control for Abortable Autonomous Overtaking

arXiv:2308.09456v2 Announce Type: replace Abstract: Overtaking on two-lane roads is a safety-critical decision-making problem for autonomous vehicles, since oncoming traffic may force the ego vehicle

29 Sept 2026

Financial Fragility in Societies of LLM Agents: Coordination Failures and Stabilizing Mechanisms

arXiv:2609.30940v1 Announce Type: new Abstract: Individually protective decisions can produce avoidable collective failures. As large language model (LLM) agents take on greater roles in financial dec

28 Sept 2026

Physics-Guided Residual Reinforcement Learning for Humanoid Narrow-Path Traversal

arXiv:2508.20661v5 Announce Type: replace Abstract: Traversing narrow paths is challenging for humanoid robots due to the sparse and safety-critical footholds required. Purely template-based or end-to

25 Sept 2026

Design and Implementation of an Ultra-Low-Cost Wall-Climbing Robot for Infrastructure Crack Detection

arXiv:2609.26130v1 Announce Type: new Abstract: Crack detection is a crucial process to ensure the safety and longevity of buildings and other infrastructure. In this paper, we developed a low-cost, a