Search: “llm”

Handoff Curves: Initial Selection, Later Handoff, and Supervision Targets in Multi-turn LLM Routing

arXiv:2610.15993v1 Announce Type: new Abstract: We study how initial model selection, later handoff, and training targets affect success and cost in LLM tasks that span multiple turns. We compare seve

15 Oct 2026

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

LLM Alignment--Utility Asymmetry under Semantic-Preserving Transformations

DGX agent

arXiv:2609.32717v2 Announce Type: replace-cross Abstract: Large Language Model (LLM) alignment is intended to ensure that models remain helpful and safe, but its stability under input distributional s

model-releasesarxiv-cs-ai

15 Oct 2026

PersEvalBench: Can LLM Evaluators Judge Contextually Appropriate Use of Persona Information?

arXiv:2610.19314v1 Announce Type: new Abstract: Large language model (LLM) evaluators are increasingly used to assess personalized assistants, yet whether they can reliably judge personalization has r

15 Oct 2026

Fast and Accurate: Improving Personalized LLM Performance by Semantic Concentration Inspired Workload Split between RAG and Fine-Tuning

model-releasesarxiv-cs-lg

arXiv:2610.15921v1 Announce Type: new Abstract: With ever increasing personalized large language model (LLM) services, the next question to answer is how to improve the quality of services/users' expe

14 Oct 2026

Agreement Without Alignment: Label-Free Rubric Clarification Increases LLM-Judge Consensus but Not Agreement with Humans

arXiv:2610.13303v1 Announce Type: cross Abstract: LLM judges are increasingly deployed as panels, and disagreement among panel members is often read as a symptom of an unclear rubric. We test a label-

12 Oct 2026

Right Order, Wrong Scale: Auditing LLM Judges for Occupational AI Measurement

arXiv:2610.02492v1 Announce Type: new Abstract: LLM judges are increasingly used to assess whether AI outputs meet workplace requirements, but agreement on response rankings does not establish agreeme

5 Oct 2026

Sentry: Learning to Recover from LLM Agent Failures at Test Time

arXiv:2610.02994v1 Announce Type: cross Abstract: LLM agents often fail mid-task due to invalid tool calls, repeated actions, or poorly grounded reasoning, and learning from these failures is a path t

5 Oct 2026

Auditing Action Settlement in LLM Agent Environments: Order, Progress, and Replay

arXiv:2610.01138v1 Announce Type: new Abstract: Concurrent actions in large language model (LLM) agent environments require arbitration even when each proposal is individually valid. We implement a ty

2 Oct 2026

Counting Moves, Weighing Voices: Bayesian Dialectical Argumentation for Calibrated Multi-LLM Councils under Persistent Adversaries

arXiv:2610.02005v1 Announce Type: new Abstract: A multi-LLM council lets several large language models (LLMs) deliberate on a question and return an answer together with a confidence estimate. As thes

2 Oct 2026

Spatial Strategies, Not Actions: Vector-Quantized Geodesics as Tools for LLM-Driven Agents

arXiv:2610.00613v1 Announce Type: new Abstract: Large language model (LLM) based agents are often criticized for lacking spatial understanding and mainly exploiting statistical text patterns. We inves

2 Oct 2026

Local Ai

VirusCascade: Hijacking Collaborative Reflection in LLM-Powered Recommender Agents

arXiv:2609.38270v1 Announce Type: cross Abstract: Advancing beyond traditional static scoring models, LLM-powered agentic recommender systems (LLM-ARS) instantiate users and items as autonomous agents

local-aiarxiv-cs-lg

1 Oct 2026

Accounting for Bias Enables Sustainable LLM Evaluation

arXiv:2609.31184v1 Announce Type: new Abstract: LLM-as-a-judge has become the de facto standard for scalable, subjective evaluation, yet current leaderboards compensate for systematic measurement bias

28 Sept 2026

Auditing and Repairing LLM-as-Judge Failures in a Production Text-to-SQL Pipeline

arXiv:2609.30290v1 Announce Type: new Abstract: Production text-to-SQL pipelines often end with an LLM-as-judge whose agreement with human annotators has never actually been measured. When we checked

28 Sept 2026

Hardware

Scepsy: Serving Agentic Workflows Using Aggregate LLM Pipelines

arXiv:2604.15186v2 Announce Type: replace-cross Abstract: Agentic workflows carry out complex tasks by orchestrating multiple large language models (LLMs) and tools. Serving them at a target throughpu

hardwarearxiv-cs-ai

28 Sept 2026

Spatial and Semantic Reasoning for LLM-Driven Robot Navigation via MCP

arXiv:2609.27340v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used as natural-language interfaces for robotic systems, yet their integration with Robot Operating System

agentsarxiv-cs-ro

24 Sept 2026

EVINCE: Optimizing Multi-LLM Dialogues Using Conditional Statistics and Information Theory

arXiv:2408.14575v5 Announce Type: replace Abstract: EVINCE (Entropy and Variation IN Conditional Exchanges) is a novel framework for optimizing multi-LLM dialogues using conditional statistics and inf

16 Sept 2026

Universal Defenses for Tool-Integrated LLM Agents Against Adversarial Attacks

arXiv:2609.16098v1 Announce Type: cross Abstract: Large Language Model (LLM) agents have demonstrated impressive capabilities across a variety of domains, particularly when integrated with external to

16 Sept 2026

MemRiskBench: Trace-Aware Risk-Preserving Evaluation for Long-Horizon LLM Agents

arXiv:2609.14976v1 Announce Type: new Abstract: Long-horizon LLM agents accumulate memory across sessions, creating sparse but high-impact risks: stale facts, conflicting updates, cross-user leakage,

15 Sept 2026

GAUGE: When Not to Trust LLM-as-a-Judge in User-Simulated Evaluation of Task-Oriented Agents

arXiv:2609.12191v1 Announce Type: new Abstract: Comparing and selecting task-oriented LLM agents increasingly relies on a low-cost offline evaluation gate: persona-driven LLM user-simulators converse

agentsarxiv-cs-cl

14 Sept 2026

Limits of LLM Text Detectors in Education

arXiv:2508.08096v2 Announce Type: replace Abstract: Students increasingly use the assistance of large language models (LLMs) in their academic writing. While slight assistance (e.g., grammar and style

14 Sept 2026

The Failure Happens Before the Drift: The Social Dynamics of Values in LLM Agent Societies

arXiv:2609.05514v1 Announce Type: new Abstract: Large Language Model (LLM)-based agents are increasingly used as proxies for human participants in social science research, yet it remains unclear wheth

10 Sept 2026

Local Ai

Epistemic Warrant for LLM Recommendations: Characterizing the Basis for Reliance When Ground Truth Is Unavailable

arXiv:2609.04127v1 Announce Type: new Abstract: Large language models are increasingly used to support organizational decisions, yet users often lack a principled basis for assessing whether to rely o

local-aiarxiv-cs-ai

4 Sept 2026

SENTINEL-RL: Offloading Topological Reasoning from LLM Agents in the Security Operations Center

arXiv:2609.04159v1 Announce Type: cross Abstract: Large language model (LLM) agents are increasingly proposed as autonomous SOC analysts, but two limitations make them unreliable at enterprise scale:

4 Sept 2026

Codebook Agent: Amortized Topology Design for LLM Multi-Agent Systems

arXiv:2609.02264v1 Announce Type: new Abstract: Adapting the communication topology of an LLM multi-agent system to each query improves both accuracy and efficiency, yet current designers treat this a

3 Sept 2026

GMTRouter: Personalized LLM Router over Multi-turn User Interactions

arXiv:2511.08590v2 Announce Type: replace Abstract: Large Language Model (LLM) routing has demonstrated strong capability in balancing response quality with computational cost. As users exhibit divers

researcharxiv-cs-cl

3 Sept 2026

MASkills: Continual Skills Optimization for Multi-Agent LLM Systems

arXiv:2609.02094v1 Announce Type: new Abstract: LLM-based multi-agent systems have shown strong performance on complex tasks, yet continual improvement from interaction experience remains challenging.

3 Sept 2026

Beyond Scores: Understanding LLM-as-a-Judge Mechanisms in Summarization Evaluation

arXiv:2609.01604v1 Announce Type: new Abstract: LLM-based evaluators of natural language generation (NLG) quality are widely deployed as scoring tools and as automated training signals, yet the intern

2 Sept 2026

S3C-LLM: Skill-Code Guided Agentic Language Models for Spectrum-to-Structure Elucidation

arXiv:2608.30910v1 Announce Type: cross Abstract: Spectroscopic structure elucidation is central to molecular analysis, but recent Large Language Model (LLM)-based methods mostly formulate it as direc

agentsarxiv-cs-cl

1 Sept 2026

FaulT-Bench: Towards Benchmarking Network Troubleshooting LLM Agents under Unreliable User Tickets

arXiv:2608.27021v1 Announce Type: cross Abstract: LLM-based agents are increasingly proposed for network fault diagnosis, but existing benchmarks evaluate them only on accurate tickets and always assu

28 Aug 2026

JudgeStealer: Extracting LLM Judging Capabilities across Evaluation Protocols

arXiv:2608.26982v1 Announce Type: new Abstract: Large language model (LLM) judges are increasingly used across various evaluation scenarios, making their judgment capabilities valuable intellectual pr

researcharxiv-cs-cl

28 Aug 2026

Trace Integrity for LLM Data Agents: A Vision for Auditable Structured Reasoning in Real-World Systems

arXiv:2608.26036v1 Announce Type: cross Abstract: Answer accuracy is an insufficient reliability signal for LLM data agents. In structured-data tasks, a benchmark-correct answer can be produced by an

27 Aug 2026

Don't Judge Code by Its Cover: Exploring Biases in LLM Judges for Code Evaluation

arXiv:2505.16222v2 Announce Type: replace Abstract: With the growing use of large language models(LLMs) as evaluators, their application has expanded to code evaluation tasks, where they assess the co

safetyarxiv-cs-cl

24 Aug 2026

SESSE: Sketch, Expand, Sort, Summarize, Evaluate -- LLM-as-Judge Evaluation via Structured Decomposition

arXiv:2608.18303v1 Announce Type: new Abstract: LLM-as-judge evaluation reduces response quality assessment to a single holistic A/B preference choice, providing no mechanism to isolate which quality

researcharxiv-cs-ai

20 Aug 2026

Beyond Handcrafted Security: Towards Self-Evolving Defense for LLM Agents

arXiv:2608.12977v1 Announce Type: cross Abstract: The expanding operational capabilities of large language model (LLM) agents introduce sophisticated security threats. Runtime defenses have emerged as

14 Aug 2026

Coupling Planning with Episodic Memory in LLM Agents for Software Issue Resolution

arXiv:2608.06811v1 Announce Type: cross Abstract: Resolving a real software issue with a large language model (LLM) agent is a long repair episode, often tens to hundreds of steps spanning exploration

10 Aug 2026

BALANCE: Hybrid Autoregressive-Speculative LLM Inference in Wireless Edge Networks

arXiv:2608.05926v1 Announce Type: cross Abstract: Edge inference is a promising paradigm to provide large language model (LLM) inference services in next-generation mobile networks. LLM inference main

researcharxiv-cs-ai

7 Aug 2026

HyperAgent: Planning and Acting over Tool-Schema Hypergraphs for Tool-Use LLM Agents

arXiv:2608.02650v1 Announce Type: new Abstract: Large language model (LLM) agents increasingly rely on external tools to complete complex real-world tasks. However, reliable tool-use planning remains

5 Aug 2026

Agreement Is Not Quality: Blind Expert Verification of Human and LLM Qualitative Coding When Human Consensus Is Not Ground Truth

arXiv:2607.28890v1 Announce Type: cross Abstract: Evaluations of LLM-assisted qualitative coding almost universally measure model performance as agreement with human coders, a practice that presumes h

3 Aug 2026

Local Ai

AlphaSchema: Exploring the Space of Trading Semantics for LLM-Based Alpha Mining

arXiv:2607.26642v1 Announce Type: new Abstract: Automated alpha mining has increasingly adopted large language model (LLM) agents for factor generation and iterative discovery. However, existing LLM-b

local-aiarxiv-cs-ai

31 Jul 2026

CORVUS: Context Optimization and Reduction Via Underlying Synchronization for LLM Coding Agents

arXiv:2607.22711v1 Announce Type: cross Abstract: LLM coding agents operate by constructing trajectories that accumulate reasoning, tool calls, and results to enable multi-step decision-making. Howeve

28 Jul 2026

LLM-SoccerArena: Benchmarking LLMs on Real-World Predictions in Sports

arXiv:2607.24573v1 Announce Type: new Abstract: Large language models (LLMs) increasingly support decisions about uncertain future events, yet evaluating their ability to forecast real-world outcomes

28 Jul 2026

SafeCRS: Personalized Safety Alignment for LLM-Based Conversational Recommender Systems

arXiv:2603.03536v2 Announce Type: replace-cross Abstract: Current LLM-based conversational recommender systems (CRS) primarily optimize recommendation accuracy and user satisfaction. We identify an un

28 Jul 2026

Reexamining zero-shot summarization: Empirical investigation of trustworthiness of LLM-summarizers

arXiv:2607.21010v1 Announce Type: new Abstract: Zero-shot summarization using Large Language Models (LLMs) has significantly advanced the abstractive summarization task by producing coherent and fluen

24 Jul 2026

Constructing coherent spatial memory in LLM agents through graph rectification

arXiv:2510.04195v2 Announce Type: replace Abstract: Given a map description through global traversal navigation instructions, an LLM can often infer the implicit spatial layout and answer user queries

10 Jun 2026

Mutation Without Variation: Convergence Dynamics in LLM-Driven Program Evolution

arXiv:2606.05408v1 Announce Type: new Abstract: When an LLM repeatedly mutates a program, does it explore new forms or circle back to the same ones? We study this question by analyzing LLM-driven muta

6 Jun 2026

Beyond Access: Guided LLM Scaffolding for Independent Learning in Undergraduate Statistics

arXiv:2606.01375v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly entering students' learning practices, but their educational value depends on whether they support reaso

2 Jun 2026

Review Arcade: On the Human Alignment and Gameability of LLM Reviews

arXiv:2605.28897v1 Announce Type: new Abstract: LLM-generated reviews for scientific papers are gaining considerable traction and are even being officially piloted by major conferences. We have to ass

29 May 2026

DVPO: Distributional Value Modeling-based Policy Optimization for LLM Post-Training

arXiv:2512.03847v2 Announce Type: replace-cross Abstract: Reinforcement learning (RL) has shown strong performance in LLM post-training, but real-world deployment often involves noisy or incomplete su