Search: “guardrails”

PromptGuard: Soft Prompt-Guided Unsafe Content Moderation for Text-to-Image Models

arXiv:2501.03544v5 Announce Type: replace-cross Abstract: Recent text-to-image (T2I) models have exhibited remarkable performance in generating high-quality images from text descriptions. However, the

12 May 2026

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Agents

Results and Retrospective Analysis of the CODS 2025 AssetOpsBench Challenge

DGX agent

arXiv:2605.08518v1 Announce Type: new Abstract: Competition retrospectives are useful when they explain what a leaderboard measured, how hidden evaluation changed conclusions, and which design pattern

agentsarxiv-cs-ai

12 May 2026

SAID: Safety-Aware Intent Defense via Prefix Probing for Large Language Models

arXiv:2510.20129v2 Announce Type: replace-cross Abstract: Large Language Models (LLMs) remain vulnerable to jailbreak attacks, where adversarially crafted prompts induce policy-violating responses des

12 May 2026

Scam2Prompt: A Scalable Framework for Auditing Malicious Scam Endpoints in Production LLMs

arXiv:2509.02372v3 Announce Type: replace-cross Abstract: Large Language Models have become critical to modern software development, but their reliance on uncurated web-scale datasets for training int

12 May 2026

FANoS-v2: Feedback-Controlled Momentum with Thermostat Damping for Lightweight Neural Optimization

arXiv:2601.00889v2 Announce Type: replace Abstract: FANOS{} is a PyTorch optimizer that augments RMS-preconditioned momentum with a scalar feedback controller over update energy. The public reference

GLiGuard: Schema-Conditioned Classification for LLM Safeguard

arXiv:2605.07982v1 Announce Type: new Abstract: Ensuring safe, policy-compliant outputs from large language models requires real-time content moderation that can scale across multiple safety dimension

GPO-V: Jailbreak Diffusion Vision Language Model by Global Probability Optimization

arXiv:2605.07399v1 Announce Type: new Abstract: Diffusion Vision-Language Models (dVLMs), built upon the non-causal foundations of Diffusion Large Language Models (dLLMs), have demonstrated remarkable

safetyarxiv-cs-cv

RedDiffuser: Auditing Multimodal Safety Failures in Vision-Language Models via Reinforced Diffusion

model-releasesarxiv-cs-cv

arXiv:2503.06223v5 Announce Type: replace Abstract: Large Vision-Language Models (VLMs) are increasingly deployed in open-ended environments, where ensuring reliable safety under multimodal inputs is

A Low-Latency Fraud Detection Layer for Detecting Adversarial Interaction Patterns in LLM-Powered Agents

arXiv:2605.01143v1 Announce Type: new Abstract: Large Language Model (LLM)-powered agents demonstrate strong capabilities in autonomous task execution, tool use, and multi-step reasoning. However, the

ContextCov: Deriving and Enforcing Executable Constraints from Agent Instruction Files

arXiv:2603.00822v2 Announce Type: replace-cross Abstract: As Large Language Model (LLM) agents increasingly execute complex, autonomous software engineering tasks, developers rely on natural language

MAGE: Safeguarding LLM Agents against Long-Horizon Threats via Shadow Memory

arXiv:2605.03228v1 Announce Type: cross Abstract: As large language model (LLM)-powered agents are increasingly deployed to perform complex, real-world tasks, they face a growing class of attacks that

safetyarxiv-cs-cl

Say the Mission, Execute the Swarm: Agent-Enhanced LLM Reasoning in the Web-of-Drones

arXiv:2605.03788v1 Announce Type: cross Abstract: Large Language Models (LLMs) are increasingly explored as high-level reasoning engines for cyber-physical systems, yet their application to real-time

agentsarxiv-cs-ro

VLMaxxing through FrameMogging Training-Free Anti-Recomputation for Video Vision-Language Models

model-releasesarxiv-cs-cv

arXiv:2605.03351v1 Announce Type: new Abstract: Video vision-language models (VLMs) keep paying for visual state the stream already told us was stable. The factory wall did not move, but most VLM pipe

Compliance-Aware Agentic Payments on Stablecoin Rails

arXiv:2605.00071v1 Announce Type: cross Abstract: Agentic payment systems extend delegated action to financial transfers, but scaling them on stablecoin rails in regulated settings requires safeguards

5 May 2026

Intelligent Elastic Feature Fading: Enabling Model Retrain-Free Feature Efficiency Rollouts at Scale

arXiv:2605.00324v1 Announce Type: cross Abstract: Large-scale ranking systems depend on thousands of features derived from user behavior across multiple time horizons. Typically requires model retrain

safetyarxiv-cs-lg

4 May 2026

Why Do LLMs Struggle in Strategic Play? Broken Links Between Observations, Beliefs, and Actions

arXiv:2605.00226v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly tasked with strategic decision-making under incomplete information, such as in negotiation and policymakin

4 May 2026

Trace-Level Analysis of Information Contamination in Multi-Agent Systems

arXiv:2604.27586v1 Announce Type: new Abstract: Reasoning over heterogeneous artifacts (PDFs, spreadsheets, slide decks, etc.) increasingly occurs within structured agent workflows that iteratively ex

1 May 2026

Auditing Marketing Budget Allocation with Hindsight Regret

arXiv:2604.25977v1 Announce Type: cross Abstract: Organizations routinely make strategic budget allocations under operational constraints, but often lack a principled way to assess whether realized al

30 Apr 2026

Self-Jailbreaking: Language Models Can Reason Themselves Out of Safety Alignment After Benign Reasoning Training

arXiv:2510.20956v2 Announce Type: replace-cross Abstract: We discover a novel and surprising phenomenon of unintentional misalignment in reasoning language models (RLMs), which we call self-jailbreaki

30 Apr 2026

Cross-Lingual Jailbreak Detection via Semantic Codebooks

arXiv:2604.25716v1 Announce Type: new Abstract: Safety mechanisms for large language models (LLMs) remain predominantly English-centric, creating systematic vulnerabilities in multilingual deployment.

29 Apr 2026

CrossGuard: Safeguarding MLLMs against Joint-Modal Implicit Malicious Attacks

arXiv:2510.17687v2 Announce Type: replace-cross Abstract: Multimodal Large Language Models (MLLMs) achieve strong reasoning and perception capabilities but are increasingly vulnerable to jailbreak att

Protecting the Trace: A Principled Black-Box Approach Against Distillation Attacks

arXiv:2604.23238v1 Announce Type: cross Abstract: Frontier models push the boundaries of what is learnable at extreme computational costs, yet distillation via sampling reasoning traces exposes closed

RCSB PDB AI Help Desk: retrieval-augmented generation for protein structure deposition support

arXiv:2604.22800v1 Announce Type: cross Abstract: Motivation: Structural Biologists have contributed more than 245,000 experimentally determined three-dimensional structures of biological macromolecul

UNSEEN: A Cross-Stack LLM Unlearning Defense against AR-LLM Social Engineering Attacks

arXiv:2604.23141v1 Announce Type: cross Abstract: Emerging AR-LLM-based Social Engineering attack (e.g., SEAR) is at the edge of posing great threats to real-world social life. In such AR-LLM-SE attac

When Models Outthink Their Safety: Unveiling and Mitigating Self-Jailbreak in Large Reasoning Models

arXiv:2510.21285v4 Announce Type: replace Abstract: Large Reasoning Models (LRMs) achieve strong performance on complex multi-step reasoning, yet they still exhibit severe safety failures such as harm

27 Apr 2026

Breaking MCP with Function Hijacking Attacks: Novel Threats for Function Calling and Agentic Models

arXiv:2604.20994v1 Announce Type: cross Abstract: The growth of agentic AI has drawn significant attention to function calling Large Language Models (LLMs), which are designed to extend the capabiliti

24 Apr 2026

From Craft to Kernel: A Governance-First Execution Architecture and Semantic ISA for Agentic Computers

arXiv:2604.18652v1 Announce Type: cross Abstract: The transition of agentic AI from brittle prototypes to production systems is stalled by a pervasive crisis of craft. We suggest that the prevailing o

22 Apr 2026

Applications

Position: No Retroactive Cure for Infringement during Training

arXiv:2604.18649v1 Announce Type: cross Abstract: As generative AI faces intensifying legal challenges, the machine learning community has increasingly relied on post-hoc mitigation -- especially mach

applicationsarxiv-cs-ai

22 Apr 2026

SafeAnchor: Preventing Cumulative Safety Erosion in Continual Domain Adaptation of Large Language Models

arXiv:2604.17691v1 Announce Type: new Abstract: Safety alignment in large language models is remarkably shallow: it is concentrated in the first few output tokens and reversible by fine-tuning on as f

21 Apr 2026

XRePIT: A deep learning-computational fluid dynamics hybrid framework implemented in OpenFOAM for fast, robust, and scalable unsteady simulations

arXiv:2510.21804v2 Announce Type: replace Abstract: Autoregressive neural surrogates offer computational acceleration for fluid dynamics but inherently suffer from error accumulation and non-physical

21 Apr 2026

Research

Can LLMs Understand the Impact of Trauma? Costs and Benefits of LLMs Coding the Interviews of Firearm Violence Survivors

arXiv:2604.16132v1 Announce Type: cross Abstract: Firearm violence is a pressing public health issue, yet research into survivors' lived experiences remains underfunded and difficult to scale. Qualita

researcharxiv-cs-ai

20 Apr 2026

AutoRAN: Automated Hijacking of Safety Reasoning in Large Reasoning Models

arXiv:2505.10846v3 Announce Type: replace Abstract: This paper presents AutoRAN, the first framework to automate the hijacking of internal safety reasoning in large reasoning models (LRMs). At its cor

17 Apr 2026

Designing Adaptive Digital Nudging Systems with LLM-Driven Reasoning

arXiv:2604.11206v1 Announce Type: cross Abstract: Digital nudging systems lack architectural guidance for translating behavioral science into software design. While research identifies nudge strategie

14 Apr 2026

Large Language Models Generate Harmful Content Using a Distinct, Unified Mechanism

arXiv:2604.09544v1 Announce Type: cross Abstract: Large language models (LLMs) undergo alignment training to avoid harmful behaviors, yet the resulting safeguards remain brittle: jailbreaks routinely

13 Apr 2026

Local Ai

Chatbot-Based Assessment of Code Understanding in Automated Programming Assessment Systems

arXiv:2604.07304v1 Announce Type: cross Abstract: Large Language Models (LLMs) challenge conventional automated programming assessment because students can now produce functionally correct code withou

local-aiarxiv-cs-ai

10 Apr 2026

Front-End Ethics for Sensor-Fused Health Conversational Agents: An Ethical Design Space for Biometrics

arXiv:2604.06203v1 Announce Type: cross Abstract: The integration of continuous data from built-in sensors and Large Language Models (LLMs) has fueled a surge of 'Sensor-Fused LLM agents' for personal