Search: “llm”

Inference-Time Target Speaker Unlearning in LLM-Based Automatic Speech Recognition

arXiv:2609.30439v1 Announce Type: new Abstract: We introduce target-speaker unlearning ASR (TSU-ASR) task in a fully end-to-end framework for multi-speaker ASR and diarization. Given a multi-speaker u

28 Sept 2026

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Research

Not All Memories Are Equal: Hierarchical Collaborative Memory for Validity-Aware Retrieval in LLM Agents

DGX agent

arXiv:2609.30289v1 Announce Type: new Abstract: In team collaboration scenarios, memory is heterogeneous and continually evolving. Team memories capture collective decisions, protocols, and current co

researcharxiv-cs-cl

28 Sept 2026

Breaking the Environment Wall: Evolving LLM Agent Environments for Recursive Self-Improvement

arXiv:2609.29773v1 Announce Type: new Abstract: Many real-world tasks (e.g., office workflows, scientific experimentation) require LLM agents to interact repeatedly with their environments for context

Tutorials

CORDIAL: Calibrating Ordinal LLM Outputs from Few Labels

arXiv:2609.29807v1 Announce Type: new Abstract: A large language model (LLM) can turn a text into a distribution over an ordered scale, but that distribution is a noisy measurement: saturated, compres

tutorialsarxiv-cs-cl

EvoTreeNAD: Genealogy-Guided Evolution for LLM-Driven Neural Architecture Discovery

arXiv:2609.29016v1 Announce Type: cross Abstract: AI-driven scientific discovery accelerates research by autonomously developing solutions and designs. Large language model (LLM) agents support this p

agentsarxiv-cs-lg

Forecast-Dojo: Replayable Environments for Benchmarking and Training LLM Forecasting Agents

arXiv:2609.28876v1 Announce Type: new Abstract: We introduce Forecast-Dojo, a replayable environment for benchmarking and training LLM forecasting agents. It combines resolved prediction-market questi

Local Ai

MeshHeal: Two-Timescale Self-Healing for Gray Failures in Decentralized LLM Agent Networks

arXiv:2609.29015v1 Announce Type: new Abstract: Decentralized LLM-based multi-agent systems coordinate through local interactions, but an agent can remain responsive while its task-solving quality per

local-aiarxiv-cs-ai

Persistent Billable State: Denial-of-Wallet Attacks and Defenses in Tool-Calling LLM Agents

arXiv:2609.28585v1 Announce Type: cross Abstract: Multi-step tool-calling LLM agents rely on host runtimes to preserve state across turns. When a runtime carries an external tool return into later mod

Progressive Skill Discovery as Access Control for Tool-Using LLM Agents: Structural Governance through Role-Scoped Capability Delivery

arXiv:2609.28693v1 Announce Type: new Abstract: Large Language Model (LLM) agents struggle to scale safely when exposed to vast enterprise toolsets. Providing an agent with access to every internal to

Robust Detection of LLM-Generated Text under Contamination

arXiv:2609.29935v1 Announce Type: cross Abstract: We study the detection of LLM-generated text under editing and contamination. Modeling human and machine text as finite-order Markov processes with Hu

Three Ways Classical Test Theory Misleads for LLM Judges

arXiv:2609.29709v1 Announce Type: cross Abstract: An LLM judge scores a bank of responses against a rubric, and the reliability comes back at 0.52. What has been measured? Judge evaluation has begun b

Towards An LLM-Driven Unified Conversion Framework for BT and FSM in Autonomous Intelligent Systems

arXiv:2609.29228v1 Announce Type: new Abstract: Finite state machine (FSM) and behavior trees (BT) are widely adopted behavioral modeling paradigms for autonomous intelligent systems. While functional

When Fancy Eviction Fails: Rethinking Cache Replacement For LLM Prefix Reuse

arXiv:2609.28870v1 Announce Type: cross Abstract: Long-running LLM applications repeatedly send growing context, making prefix caching critical for reducing prefill cost. Yet prefix-cache behavior und

agentsarxiv-cs-lg

Tutorials

Where LLM Graders Succeed and Break: Evidence from Two Computer-Science Exams

arXiv:2609.29333v1 Announce Type: cross Abstract: One long-form exam in a large course costs hundreds of grader-hours, and qualified graders are scarce; LLM graders are a tempting alternative. To show

tutorialsarxiv-cs-ai

Safety

CS-WCP: Robust Conformal Sets for LLM-Judge Traffic Shifts with Uncertain Group Proportions

arXiv:2609.27955v1 Announce Type: new Abstract: Prediction sets built from an LLM judge can undercover when deployment traffic changes the prevalence of task or policy groups. Weighted conformal predi

safetyarxiv-cs-lg

Evaluating Feedback Focus and Pedagogical Adaptivity in LLM-Generated Feedback on Student Writing

arXiv:2609.28026v1 Announce Type: cross Abstract: We investigate whether state-of-the-art large language models (LLMs) generate feedback that reflects the pedagogical practices of expert teachers in t

MLPerf Training Introduces Its First LLM Post-Training Benchmark

MLPerf Training v6.1 adds an agentic reinforcement-learning workload that measures how quickly systems can teach a 397-billion-parameter language model to repair real software projects. The post MLPer

model-releasesmlcommons

When Accuracy Gaps Fail to Certify: Auditing Cross-Domain Recalibration of LLM Judges

arXiv:2609.27954v1 Announce Type: new Abstract: A scalar recalibration map fitted for an LLM judge on one task can fail when the task distribution changes, but the source-target accuracy gap is often

researcharxiv-cs-lg

Hardware

Accelerating the Mitigation of LLM Inference Nondeterminism Across GPU Architectures

arXiv:2609.25624v1 Announce Type: cross Abstract: Large language model (LLM) outputs are expected to be reproducible under greedy decoding, yet in practice the same model, prompt, and software stack p

hardwarearxiv-cs-lg

AIBuildAI-2.5: Efficient Autonomous AI Model Development Through LLM-Guided Tree Search

arXiv:2609.25047v1 Announce Type: new Abstract: Autonomous agents that automatically build artificial intelligence (AI) models could broaden access to AI across science and engineering. A popular line

DUMA-Bench: A Dual-Control Multi-Agent Benchmark for Evaluating LLM Agent Security

arXiv:2609.24662v1 Announce Type: new Abstract: LLM-based agents increasingly operate in environments where they interact with users, tools, and external systems. Yet most security evaluations assume

Efficient Cost-Aware LLM Evaluation via Bayesian Bandit Gittins Indices

arXiv:2609.25645v1 Announce Type: cross Abstract: Exhaustively evaluating every candidate LLM configuration on every benchmark item to identify a high-performing one is costly. We formulate configurat

Safety

How Strongly Should Task State Influence an LLM Agent?

arXiv:2609.25686v1 Announce Type: cross Abstract: Long-horizon assigned work requires an LLM agent to track the state of a task: which steps are done, blocked, cancelled, or open to repetition. Agent

safetyarxiv-cs-cl

Jev vs. LLM-as-a-Judge: Accuracy and cost benchmarks

We benchmarked Jev against Claude Opus 5 and GPT-5.6 Terra on accuracy, cost, and latency. Learn how threshold tuning changes hallucination detection. The post Jev vs. LLM-as-a-Judge: Accuracy and cos

model-releasesarize-ai

Local Ai

LLM-Driven Training-free Location-Attribute Synergic Fusion: A Closed-Loop Paradigm for Dual-source Encrypted POIs and LULC Mapping

arXiv:2609.25051v1 Announce Type: new Abstract: Dual-source encrypted points of interest (DSEP), POIs from two encrypted coordinate systems, suffer from intertwined location and attribute uncertaintie

local-aiarxiv-cs-cl

MAWILE: Multi-Axis Workbench for Inspecting LLM Evaluators

arXiv:2609.22599v1 Announce Type: new Abstract: Large language model (LLM) judges provide a flexible and scalable method for evaluating model and agent outputs, but their verdicts can be sensitive to

Local Ai

PatchKV: Efficient KV Cache Recovery for Dynamically Edited LLM Contexts

arXiv:2609.26219v1 Announce Type: cross Abstract: Long-running LLM agent workflows often revise interior context spans while retaining long suffixes. Although suffix tokens remain unchanged, altered c

local-aiarxiv-cs-lg

Silent Sabotage: Internal State Triggered Backdoor Attacks on LLM-Powered Robotic Systems

arXiv:2609.26184v1 Announce Type: new Abstract: The integration of Large Language Models (LLMs) into robotic control systems is enabling a new generation of autonomous agents capable of complex reason

agentsarxiv-cs-ro

SyzHarness: Patch-Based Kernel Bug Reproduction with LLM-Synthesized Fuzzing Harnesses

arXiv:2609.23889v1 Announce Type: cross Abstract: Automated kernel vulnerability reproduction is essential for bug triage, patch validation, and regression testing, but still lacks an effective and ef

Terminal Shrinkage Averaging Reveals a Schedule-Estimator Interaction in LLM Pretraining

arXiv:2609.25482v1 Announce Type: new Abstract: Large language model (LLM) pretraining conventionally returns the raw final iterate. This couples two design choices: the learning-rate schedule that ge

Total Cost of Agency: Exact Attribution of Memory Injection Cost in Multi-Agent LLM Workflows

arXiv:2609.23790v1 Announce Type: new Abstract: Every node in a multi-agent large language model (LLM) workflow retrieves context from memory and injects it into its prompt, where those injected token

Applications

Ultra Strong Machine Learning: LLM-Generated Explanations Do Not Yet Suffice for Teaching Humans Active Learning Strategy

arXiv:2509.00961v3 Announce Type: replace-cross Abstract: Active learning is a general learning mechanism shared by artificial and human learners. Whether AI can teach humans such a strategy that tran

applicationsarxiv-cs-lg

BabelArena: A Large-Scale Multilingual Benchmark for LLM Agents

arXiv:2609.23490v1 Announce Type: new Abstract: Large language model (LLM) agents increasingly execute multi-step workflows through tool use and interaction with users and environments. However, curre

CTRL: Control-Based Time Series Forecasting with LLM-Guided Residual Learning

arXiv:2609.23257v1 Announce Type: cross Abstract: Time series forecasting underpins critical decision-making across diverse domains. While large language models (LLMs) offer promising reasoning capabi

agentsarxiv-cs-cl

Defusing Explosive Prompts: Understanding and Preventing Trigger-Based Prompt Injections in LLM Agents

arXiv:2609.22510v1 Announce Type: cross Abstract: As LLM applications integrate with external tools, they are increasingly exposed to indirect prompt injection (IPI), where adversarial instructions ar

Safety

Emergent Collusion in Long-Horizon LLM Agent Interaction

arXiv:2609.24967v1 Announce Type: cross Abstract: LLM agents are increasingly deployed in collaborative settings, yet long-term interaction may give rise to undesirable coordination. We study the emer

safetyarxiv-cs-cl

Knowing, and Saying It Only When Asked: LLM Endognostics and the Schizognosis of Minerva-7B

arXiv:2609.22219v1 Announce Type: new Abstract: Evaluating an aligned language model by reading its answers assumes the answers carry the distinction the evaluator cares about. We introduce LLM endogn

MCP-GRANITE Benchmark: GRANularity Interface TEsting for MCP-Based LLM Agents

arXiv:2609.24161v1 Announce Type: cross Abstract: As LLM agents increasingly interact with external tools through standardized protocols such as MCP, tool-interface design becomes a critical yet under

MemCalib: Benchmarking and Optimizing Memory Use in LLM Agents

arXiv:2609.24259v1 Announce Type: new Abstract: The effectiveness of agent memory ultimately depends on whether the underlying LLM gives each memory in context an appropriate degree of influence over

Observational Equivalence of LLM and Human Annotation

arXiv:2609.22133v1 Announce Type: new Abstract: In this paper, we show that LLM and human coding are observationally equivalent in terms of annotation quality: recent LLMs agree with expert coders at

PII-TRACE: A Benchmark for Context-Aware PII Detection in Multi-Turn LLM Conversations

arXiv:2609.22200v1 Announce Type: new Abstract: LLM assistants and agentic systems log long multi-turn conversations. AI providers often scan these conversations for Personally Identifiable Informatio

PSD: Pseudo Self-Distillation of Memory Representation Capabilities for LLM Agents

arXiv:2609.23449v1 Announce Type: cross Abstract: Memory systems are becoming a core component of LLM agents, but constructing and maintaining memory remains expensive because it relies on repeated ca

RPMem: Learning Long-Term Recurrent Parametric Memory Across Sessions for LLM Agents

arXiv:2609.23466v1 Announce Type: new Abstract: Long-running LLM agents require memory that persists and evolves across sessions. Text-based memory retrieves and reconstructs past interactions at ever

Using Composition Operators to Linearize LLM Semantic Transformations

arXiv:2609.22143v1 Announce Type: new Abstract: Machine learning learns functions: prompt to response, image to caption. What these functions are mathematically remains hard to say. We present a metho

Bayesian Belief Layer for Controllable Opinion Dynamics in LLM Agents

arXiv:2609.21997v1 Announce Type: cross Abstract: LLM agents in social simulation revise their opinions implicitly, in context: how open an agent is to persuasion can neither be specified nor verified

Constraint Decay: The Fragility of LLM Agents in Backend Code Generation

arXiv:2605.06445v2 Announce Type: replace-cross Abstract: Large Language Model (LLM) agents demonstrate strong performance in autonomous code generation under loose specifications. However, production

Efficient Benchmarking in Production: A Study of an Evolving LLM Agent

arXiv:2609.21267v1 Announce Type: new Abstract: Production LLM agents are evaluated repeatedly as they evolve, but full agent benchmarks are costly to rerun. We study efficient recurring evaluation fo

Free SemIf this week is useful. Typed outputs + probabilities look like a cleaner way to route agents than parsing LLM text every time.

Free SemIf this week is useful. Typed outputs + probabilities look like a cleaner way to route agents than parsing LLM text every time. jev is a new type of model - 'decision models' there are a few o

agentsharrison-chase--x