Search: “llm”

AgentProv: Auditing Agentic LLM API Providers via Tool-use Policy Probes

model-releasesarxiv-cs-cl

arXiv:2609.00052v1 Announce Type: cross Abstract: Commercial LLM APIs advertise a specific foundation model, but the served backbone may be silently substituted, quantized, or wrapped, for example to

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Agents

Delegation Without Trust: An Empirical Gap Analysis of Identity, Authorization, and Runtime Governance in Multi-Agent LLM Systems

DGX agent

arXiv:2609.00267v1 Announce Type: cross Abstract: Autonomous LLM agents increasingly act on a user's behalf: they hold credentials, call tools and services, and spawn sub-agents that act further on th

agentsarxiv-cs-ai

2 Sept 2026

Don't Let the Model Write the YAML: Deterministic, Minimal-Diff GitOps Remediation from LLM-Proposed Field Changes

arXiv:2609.00227v1 Announce Type: cross Abstract: LLM agents increasingly diagnose incidents and propose remediations. In a GitOps workflow, applying a fix means editing a version-controlled config fi

Hardware

From Production Traffic to Post-Training: Building a Self-Hosted LLM That Covers the Corporate Request Mix

arXiv:2609.01572v1 Announce Type: new Abstract: Data-residency constraints force enterprises to self-host LLMs, but continuous adoption of newer models without decommissioning their predecessors expan

hardwarearxiv-cs-cl

Learning What to Retain: Gated-Memory Routing for Efficient Collaboration in Multi-Agent LLM Systems

arXiv:2609.00237v1 Announce Type: new Abstract: Large language model (LLM)-based multi-agent systems tackle complex reasoning by orchestrating how multiple agents are configured and how they collabora

Skill Following: Evaluating Actual Skill Use in Retrieval-Enabled LLM Agents

arXiv:2609.00549v1 Announce Type: new Abstract: Large Language Model (LLM) agents increasingly rely on external skills, yet standard evaluations obscure whether retrieving these skills actually helps.

safetyarxiv-cs-cl

SoK: When Safe Agents Fail Together: The Security of Multi Agent LLM Systems

arXiv:2609.00595v1 Announce Type: cross Abstract: Safe agents can fail together. Multi-agent LLM systems (MAS) move information, state, decisions, and authority across principal boundaries, creating f

SOVER: Formal Certification of Optimization Reformulations via LLM-Assisted SMT Verification

arXiv:2609.00728v1 Announce Type: new Abstract: Large Language Models (LLMs) have shown remarkable promise in translating and reformulating complex mathematical optimization problems across modeling l

The Safeguard Worked. Is the LLM System Safer?

arXiv:2609.00519v1 Announce Type: cross Abstract: Safeguards in deployed LLM services are evaluated by refusal, attack success, and policy violation rates. Those rates characterize how a control perfo

BiasMix-Finance: Post-Generation KYC Guardrails for LLM Portfolio Advice

arXiv:2608.28646v1 Announce Type: new Abstract: Large language models (LLMs) can generate plausible-sounding ETF portfolios while silently violating basic KYC-style constraints on risk, fees, and dive

Detecting and Guiding LLM-Generated Korean Poetry with Interpretable Form-level Features

model-releasesarxiv-cs-cl

arXiv:2608.28986v1 Announce Type: new Abstract: LLMs often struggle with modern Korean poetry, producing outputs that resemble 'line-broken prose.' We address two coupled tasks: detecting whether a Ko

GreenBench: Benchmarking Energy Efficiency and Carbon Footprint of Open-Source LLM Inference on Apple Silicon

arXiv:2608.28667v1 Announce Type: cross Abstract: The rapid proliferation of Large Language Models (LLMs) has raised concerns about their environmental impact during inference. While Green AI research

How do World Models and Policies Compose in LLM Agents? A Joint Spectral and Behavioral Account

arXiv:2608.30067v1 Announce Type: cross Abstract: How do LLM agents come to both understand environments they act in and master tasks set within them? Through controlled experiments combining world-mo

Hardware

Kascade: A Practical Sparse Attention Method for Long-Context LLM Inference

arXiv:2512.16391v2 Announce Type: replace-cross Abstract: Attention is the dominant source of latency during long-context LLM inference, an increasingly popular workload with reasoning models and RAG.

hardwarearxiv-cs-ai

Learning Simple Test-Time Environments for LLM Web Agents

arXiv:2608.29305v1 Announce Type: cross Abstract: Large language model (LLM) agents have demonstrated remarkable proficiency in manually constructed environments, yet their performance frequently coll

LLM-Based Knowledge Graph Completion Combining Discrete Structural Coding with Similar Entity Information

arXiv:2608.30235v1 Announce Type: new Abstract: Knowledge graph completion requires models to use both textual descriptions and relational structure. Existing LLM-based methods either encode KG struct

researcharxiv-cs-ai

Measurement Validity in LLM Cultural Alignment

arXiv:2608.29266v1 Announce Type: cross Abstract: Researchers increasingly treat LLM survey responses as a proxy for human cultural values. This includes projecting model outputs onto instruments like

SemPOI-RL: Aligning LLM Semantic Reasoning for Interpretable Out-of-Town POI Sequential Generation

arXiv:2608.30399v1 Announce Type: cross Abstract: Large language models (LLMs) exhibit strong semantic reasoning and open-ended generation abilities, but aligning these abilities with structured seque

T-MAP: Red-Teaming LLM Agents with Trajectory-aware Evolutionary Search

arXiv:2603.22341v2 Announce Type: replace-cross Abstract: While prior red-teaming efforts have focused on eliciting harmful text outputs from large language models (LLMs), such approaches fail to capt

The Differential Reasoning Router: Operationalizing Cost-Aware LLM Annotation in E-commerce

arXiv:2608.30224v1 Announce Type: cross Abstract: Large Language Models (LLMs) are increasingly used to annotate structured product data in e-commerce, but early deployment often begins as a cold-star

applicationsarxiv-cs-ai

Local Ai

H-Scale: Hessian-Guided Scale Refinement for NVFP4 Sub-Byte LLM Inference

arXiv:2608.28113v1 Announce Type: new Abstract: The NVIDIA Blackwell architecture, with native support for the ultra-fine-grained NVFP4 format, opens new opportunities for accelerating large language

local-aiarxiv-cs-cl

31 Aug 2026

Tutorials

How to reduce LLM costs without sacrificing quality

Trace where your AI budget goes, identify the requests that do not justify their spend, and validate lower-cost alternatives with Arize AX. The post How to reduce LLM costs without sacrificing quality

tutorialsarize-ai

31 Aug 2026

Beyond Capability Benchmarks: Learning Operational Fingerprints of LLM Cloud Services from Production Incident Metadata

arXiv:2608.26332v1 Announce Type: new Abstract: Managed LLM services are now part of real production systems, but model selection and service planning still rely heavily on capability benchmarks that

applicationsarxiv-cs-lg

Local Ai

MCCE: A Framework for Multi-LLM Collaborative Search in Discrete Spaces with Similarity-Filtered Preference Learning

arXiv:2510.06270v2 Announce Type: replace-cross Abstract: Multi-objective discrete optimization problems, such as molecular design, pose significant challenges due to their vast and unstructured combi

local-aiarxiv-cs-ai

NeuronFuzz: Safety Neuron Guided Fuzzing for LLM Safety Evaluation

arXiv:2608.26222v1 Announce Type: cross Abstract: Safety evaluation is critical for assessing whether aligned Large Language Models (LLMs) remain robust against jailbreak attacks. Existing automated t

Understanding Evolution Strategies for LLM Reasoning: Broader Reasoning Coverage than GRPO

model-releasesarxiv-cs-lg

arXiv:2608.27351v1 Announce Type: new Abstract: Evolution Strategies (ES) have recently emerged as a memory-efficient post-training paradigm for LLM reasoning. However, the optimization behavior of ES

When Tool Outputs Become Commands: Separating Action Induction from Runtime Authorization in Tool-Augmented LLM Agents

arXiv:2608.27146v1 Announce Type: new Abstract: Tool-augmented LLM agents must rely on untrusted runtime Observations to complete open-ended tasks; however, when tool outputs no longer merely provide

Unveiling Spectral Mechanisms in Training-Free LLM Text Detection

arXiv:2608.25944v1 Announce Type: new Abstract: The rapid advancement of Large Language Models (LLMs) makes it increasingly difficult to distinguish human writing from machine-generated text. Training

researcharxiv-cs-cl

27 Aug 2026

Auditing the Synthetic Memoir: Measuring Scene-Level Confabulation in LLM-Generated Autobiography Against the Documented Record of the Life It Describes

arXiv:2608.23640v1 Announce Type: new Abstract: When a large language model (LLM) is asked to write a person's life, how much of what it writes actually happened? We present a scene-level case-study a

applicationsarxiv-cs-ai

Hardware

Elastic KV Cache for LLM Serving:A Working Reclamation Mechanism, and Why Chunked Prefill Already Closes the Gap

arXiv:2608.23658v1 Announce Type: cross Abstract: An LLM serving engine sizes its key-value (KV) cache once, at startup, permanently setting aside a reserve for the worst-case prefill activation. Duri

hardwarearxiv-cs-ai

Ethical LLM-Assisted Research: A Framework for Responsible Delegation, Verification, and Epistemic Value

arXiv:2608.23644v1 Announce Type: new Abstract: Large language models (LLMs) are becoming routine instruments of scientific research, assisting with literature synthesis, hypothesis development, codin

researcharxiv-cs-ai

'Ghaib in Translation' aka Unseen Harm: Measuring Cross-Script Safety Inconsistency with 'Missed-in-Urdu' Scores in LLM Hate Speech Detection

arXiv:2608.24191v1 Announce Type: cross Abstract: Urdu, the world's tenth most spoken language with 246 million speakers, remains almost entirely absent from mainstream LLM safety evaluation and nine

Knowing When to Ask for Help: Bayesian Self-Escalation in Hierarchical LLM Agents

arXiv:2608.24087v1 Announce Type: cross Abstract: Current LLM agent systems decide delegation before reasoning begins (a router picks a model) or after a response is complete (a verifier scores it and

PeakBench: Benchmarking Resource-Aware Tool Invocation in LLM Agents

arXiv:2608.24509v1 Announce Type: new Abstract: LLM agents increasingly solve tasks by invoking multiple tools, where parallel execution is essential for low latency but difficult to manage safely. Ex

When 'Must' Becomes 'Maybe': Constraint Weakening in LLM Agent Workflows

arXiv:2608.24569v1 Announce Type: new Abstract: Large language model (LLM) agents coordinate complex tasks through multi-role and multi-stage workflows. Upstream state is repeatedly transformed into i

When Youth Enter The Chat: An Epistemic Shift in the Validation of LLM-Based Measures of Student Talk

arXiv:2608.23780v1 Announce Type: cross Abstract: LLMs are being used increasingly to measure aspects of student discourse (e.g. talk moves, collaboration, equity of voice) at scale. Typically, LLM-ba

applicationsarxiv-cs-ai

Toward Effective and Reliable LLM Agents via Dynamic Ontology

arXiv:2608.22974v1 Announce Type: new Abstract: Large language model (LLM) agents rely heavily on knowledge encoded in model parameters or presented as unstructured context. In domain-specific tasks,

researcharxiv-cs-ai

25 Aug 2026

Beyond End-to-End Success: Diagnosing Failures in Long-Horizon Security LLM Agents

arXiv:2608.20563v1 Announce Type: cross Abstract: Long-horizon security LLM agents must carry information and decisions across many dependent interactions, where later actions often depend on services

24 Aug 2026

Don't Solve, Just Compare: Tiny Advisors for Runtime Intervention in LLM Agents

arXiv:2608.21027v1 Announce Type: new Abstract: LLM agents are emerging as an important paradigm for real-world tasks that require reasoning, tool use, and sequential decision-making. As these agents

24 Aug 2026

This is one of the most useful writeups I have seen on keeping an LLM judge effective in production. (bookmark it) Netflix runs judges over …

This is one of the most useful writeups I have seen on keeping an LLM judge effective in production. (bookmark it) Netflix runs judges over hundreds of thousands of show-level recommendation explanati

safetydair-ai--x

24 Aug 2026

Break It Down, Pass It On: Cross-Task Skill Transfer in LLM Agents

arXiv:2608.20274v1 Announce Type: new Abstract: Large language model (LLM) agents can induce skills from completed tasks and reuse them later to grow more capable with experience. In practice, induced

Enforcing LLM Safety through DMD-based Classification of Prompt-Response Embedding Dynamics

arXiv:2608.19579v1 Announce Type: new Abstract: Large Language Models (LLMs) are increasingly deployed in high-stakes applications, yet their tendency to generate toxic, harmful, or policy-violating c

ReguSim: Evaluating LLM Agent Rule Grounding in Financial Compliance

arXiv:2608.19974v1 Announce Type: new Abstract: LLM agents in financial markets may cite rules yet still submit orders that violate executable constraints or misread surveillance evidence. We introduc

Remember, Verify, or Ask? Cross-Family Evaluation of Memory Commitment in LLM Agents

model-releasesarxiv-cs-cl

arXiv:2608.19564v1 Announce Type: new Abstract: Persistent memory can personalize an LLM agent, but an incorrect durable update can silently distort future behavior. We study the memory-clarification

Decomposing Wrong-Consensus Agreement in LLM Self-Consistency: A GPT-4.1 Case Study

arXiv:2608.18795v1 Announce Type: cross Abstract: Majority voting over multiple LLM samples is widely used to raise answer accuracy, yet its gain varies erratically: on hard questions it can even back

GAPL: Grounded Action-effect Policy Learning for LLM-Based Trajectory Planning

arXiv:2608.18254v1 Announce Type: new Abstract: Trajectory planning for autonomous driving requires both high-level reasoning and precise low-level control. Large Language Models (LLMs) offer semantic

safetyarxiv-cs-ro

LEDGER: Claim-to-Evidence Trace Graphs for Auditing LLM Agents

arXiv:2608.18398v1 Announce Type: cross Abstract: Large language model (LLM) agents can now carry out long-horizon technical workflows involving complex tool use, code execution, file edits, and gener

The Lifecycle of LLM-as-a-Judge for Large-Scale Recommendation Explanations

arXiv:2608.18300v1 Announce Type: new Abstract: LLM-as-a-Judge, which leverages a large language model to evaluate natural language generated by another AI application or model, has become a standard,