Search: “llm”

Are We Grading Properly? Understanding Failure Modes in Medical Benchmarks

arXiv:2609.16023v1 Announce Type: new Abstract: Medical evaluation is shifting from static option-based questioning to realistic clinical scenarios with open-ended output modes. Grading these at scale

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

BLINDSPOT: A Benchmark for Safety and Refusal Calibration in Long-Horizon Tool-Using Agents

DGX agent

arXiv:2609.16305v1 Announce Type: new Abstract: Large language model (LLM) agents increasingly operate over long-horizon interactions involving tool use, persistent state, evolving authorization, and

model-releasesarxiv-cs-ai

16 Sept 2026

Can We Do Interpretable NLI with Graphs Based on Atomic Propositions?

arXiv:2609.16814v1 Announce Type: new Abstract: While Large Language Model (LLM)-based Natural Language Inference (NLI) systems achieve high accuracy, their decision-making processes lack auditable st

Challenges of Auditing: Variability in Outputs of Large Language Models for Health

arXiv:2609.16590v1 Announce Type: new Abstract: People increasingly use frontier AI models for health advice, but via different access modes (e.g., ChatGPT, ChatGPT Health, APIs) with varying settings

Decomposition Buys Integrity, Not Yield

arXiv:2609.17464v1 Announce Type: cross Abstract: Multi-agent systems split a task across a tree of agents and justify the split with folklore: smaller contexts, cleaner separation, parallelism. We as

Hardware

FlashVector: Agent for Hierarchical Model Serving Stack Optimization

arXiv:2609.17391v1 Announce Type: new Abstract: Model serving is one of the largest cost drivers in production recommender systems. Maximizing its throughput requires navigating a deeply layered hiera

hardwarearxiv-cs-ai

Models as Governed Interfaces for AI-Native MBSE: Read-Side Adequacy and Write-Side Admissibility

arXiv:2609.16252v1 Announce Type: cross Abstract: Machine-readable models such as SysML v2 are now programmatically accessible, and a growing body of work treats that access as the enabling condition

Neuro-Symbolic Synergy for World Modeling

arXiv:2602.10480v4 Announce Type: replace Abstract: Large language models (LLMs) exhibit strong general-purpose reasoning capabilities, yet they frequently hallucinate when used as world models (WMs),

agentsarxiv-cs-cl

Safety

Optimal Model Activation Policies for Inference Networks of Large Language Models

arXiv:2609.15992v1 Announce Type: new Abstract: Recent advances in large language models (LLMs) have rendered them necessary for Natural Language Processing (NLP) tasks, and their high inference cost

safetyarxiv-cs-cl

RAG-CT: Mitigating Privacy Risks on Retrieval-Augmented Generation Systems via Scanning Prompt Distribution

arXiv:2609.16095v1 Announce Type: cross Abstract: Retrieval-Augmented Generation (RAG) has emerged as a powerful paradigm for improving the quality of generated contents of Large Language Models (LLMs

Local Ai

RepoAtlas: Guiding Coding Agents via Evolving Multimodal Repository Views

arXiv:2609.16936v1 Announce Type: cross Abstract: Large language model (LLM)-powered coding agents have made rapid progress in automating software engineering tasks, yet repository-level issue resolut

local-aiarxiv-cs-ai

RoleBreak: Benchmarking Long-Horizon Role-Playing Robustness in Spoken Dialogue

arXiv:2609.16614v1 Announce Type: cross Abstract: Speech-to-speech dialogue models increasingly support persona control, yet existing spoken role-playing benchmarks remain largely character-centric an

Test-Time Unlearning via Sparse Autoencoder

arXiv:2609.16229v1 Announce Type: cross Abstract: Machine unlearning aims to remove specific knowledge from a trained large language model (LLM) without retraining from scratch. Existing methods modif

Towards Detecting AI-Assisted Responses in Online Surveys

arXiv:2609.17317v1 Announce Type: new Abstract: The use of LLMs to complete online surveys impacts the validity of survey-based research, but detecting such usage remains underexplored. We introduce a

You Don't Need To Train: Agentic Heuristic Learning Studio for Executable Human Activity Recognition

arXiv:2609.16065v1 Announce Type: cross Abstract: Human activity recognition (HAR) is usually framed as gradient-based training of neural networks. Agentic Heuristic Learning (AHL) Studio explores a c

Assessing the Applicability of Existing Design Recommendations to AI Companion Design: A Multi-Method Study

arXiv:2609.14236v1 Announce Type: cross Abstract: With the rapid proliferation of large language model (LLM)-based systems, AI companions have emerged as conversational agents designed to cultivate em

AttnFuse: A Composable DSL for Compiling Attentions to Fused GPU Kernels

model-releasesarxiv-cs-lg

arXiv:2609.13612v1 Announce Type: new Abstract: Modern AI systems are built on the Transformer architecture, whose core operation, attention, accounts for the majority of computation and memory cost.

BusMA: A Bus Communication Substrate for Multi-Agent Systems

arXiv:2609.15054v1 Announce Type: new Abstract: Multi-Agent (MA) systems are effective at solving complex tasks that demand planning, tool use, and the synthesis of evidence from multiple sources. Exi

Calibrating Interpretability Instruments Before Trusting Their Verdicts

arXiv:2609.14754v1 Announce Type: cross Abstract: Causal claims about large language model (LLM) internals rest on measurements. Those might include a projection, a cosine, an ablation delta, or an in

Can We Trust the Judges? Validation of Factuality Evaluation Methods via Answer Perturbation

arXiv:2609.15561v1 Announce Type: new Abstract: Evaluating the factual correctness of large language models (LLMs) is vital for many applications. But are our evaluation tools themselves trustworthy?

Carryover Drafting: Recycling Rejected States for Speculative Decoding

arXiv:2609.14717v1 Announce Type: cross Abstract: Speculative decoding accelerates LLM inference by verifying multiple drafted tokens in parallel, allowing a single target forward pass to accept sever

CLEAR: Context Augmentation from Contrastive Learning of Experience via Agentic Reflection

arXiv:2604.07487v2 Announce Type: replace Abstract: Large language model agents rely on effective model context to obtain task-relevant information for decision-making. Many existing context engineeri

Data Security in Large Language Models: Risks, Defense, and Directions

arXiv:2508.02312v2 Announce Type: replace-cross Abstract: Large Language Models (LLMs), now a foundation in advancing natural language processing, power applications such as text generation, machine t

Local Ai

DynSTEER: Dynamic Stage-wise Trajectory Evaluation and Execution-time Review for Agents

arXiv:2609.14637v1 Announce Type: new Abstract: Large language model agents are increasingly deployed for long-horizon task execution. However, current evaluation paradigms face three major limitation

local-aiarxiv-cs-ai

EvoOntology: A Self-Evolving Ontology Layer for Data Agents

arXiv:2609.15779v1 Announce Type: new Abstract: Data agents aim to fulfill natural-language instructions over heterogeneous data, including tables, files, and databases. However, data agents face a ch

From Semantic to Token Communication: The Next Paradigm for Large-Model-Driven 6G Intelligent Connectivity

arXiv:2609.10714v1 Announce Type: cross Abstract: The ambitious requirements of sixth-generation (6G) networks are driving communication systems from reliable bit delivery toward meaning-aware and tas

HazardAuditor: From Executable Threats to Safer Computer-Use Agents

arXiv:2609.15134v1 Announce Type: new Abstract: Computer-use agents increasingly interact with browsers, terminals, file systems, and external services, introducing safety risks that emerge through ru

How broad is that claim? Mapping Generalisation in NLP Research

arXiv:2609.14770v1 Announce Type: cross Abstract: Generalisations are common in scientific communication, even though they are semantically ambiguous. An automated method is needed to identify and cat

IWC-Bench: Evaluating Web Application Generation from a Software Testing Perspective

arXiv:2609.15387v1 Announce Type: cross Abstract: Human evaluation provides a direct measure of the quality of LLM-generated web applications. However, fitting human judgments through automated evalua

ModiGen: A Large Language Model-Based Workflow for Multi-Task Modelica Code Generation

arXiv:2503.18460v2 Announce Type: replace-cross Abstract: Modelica is a widely adopted language for simulating complex physical systems, yet effective model creation and optimization require substanti

North Small Translate: Advanced Cost-Effective Translation (Cohere CAT+)

arXiv:2609.13916v1 Announce Type: new Abstract: We present North Small Translate, an open-weight, LLM-based machine translation (MT) model with instruction-following capabilities built on the same fou

agentsarxiv-cs-cl

One Size Does Not Fit All: Setting Inference Depth from the Questions a Deployment Actually Asks

arXiv:2609.14144v1 Announce Type: new Abstract: A transformer language model is trained to respond to any prompt, but each deployment asks only a narrow range of questions: a support assistant sees de

Positioning manuscripts in the scientific landscape with agentic AI

arXiv:2609.13760v1 Announce Type: new Abstract: Publishing a research manuscript is a routine yet demanding part of scientific life: time-consuming, stressful, and often uncertain in outcome. Recent a

Psychosis involves a deficit of information compression in connected speech

arXiv:2609.15522v1 Announce Type: new Abstract: Large language models (LLMs) with human-like performance on linguistic tasks have transformed the study of language in neurodiverse conditions. LLMs pro

RESKILL: Explicit Failure Attribution and Structured Repair for Interactive Language Agents

arXiv:2609.15684v1 Announce Type: new Abstract: Language agents increasingly rely on reusable skills, but post-failure repair is often handled by opaque one-shot reflection: a model generates a skill

Robust and Efficient Communication for Multi-Agent Learning

arXiv:2609.15361v1 Announce Type: cross Abstract: Effective communication is a cornerstone of distributed intelligence in Multi-Agent Reinforcement Learning (MARL), yet ensuring that generated message

Root-Cause Attribution Is a Search Problem: Continual Search for Long-Horizon Agent Failures

arXiv:2609.13463v1 Announce Type: new Abstract: The increasing deployment of AI agents in long-horizon tasks yields massive execution logs. Diagnosing failures within these records is crucial for reli

Self-Evolving Memory for Generative Recommendation

arXiv:2609.15598v1 Announce Type: cross Abstract: Generative recommendation has emerged as a promising end-to-end paradigm for personalized recommendation. However, user preferences continuously evolv

SkillAtlas: An Attack Trace Library for Agent Skills

arXiv:2609.13353v1 Announce Type: cross Abstract: Agent skills are reusable units for language-model agents, but their risks emerge through model decisions, user context, tool calls, and execution fee

SkillLift: Learning Dense Rubrics from Sparse Oracles for Efficient Skill Evolution

arXiv:2609.15396v1 Announce Type: new Abstract: LLM-based agents increasingly rely on persistent skills, i.e., reusable procedural prompts, to adapt without weight updates. Existing skill self-evoluti

Spook the Machine: Gamified Exploration of Human Imagination of Machine Fear

arXiv:2609.15472v1 Announce Type: cross Abstract: What happens when AI machines express fear? Do humans engage differently depending on how they express it? And what does it take to design for affecti

Token Efficient Task Execution via Application Behavior Modeling for Web Agents

arXiv:2609.13491v1 Announce Type: new Abstract: The strong performance of AI Agents across an impressive variety of tasks is driving an unprecedented investment in agentic infrastructures, however the

Trustworthy, Explainable, and Sustainable Decentralized Intelligence for 6G Networks

arXiv:2609.13872v1 Announce Type: cross Abstract: As 6G networks transition from theoretical frameworks into operational realities, artificial intelligence (AI) evolves from an add-on optimization too

Local Ai

Where to Look and What to Use: Retrieve-Localize-Generate for Long-Term Conversational Memory Question Answering

arXiv:2609.07093v2 Announce Type: replace Abstract: Retrieval-augmented generation (RAG) enables large language models (LLMs) to answer questions by accessing external knowledge and has been widely ad

local-aiarxiv-cs-cl

WISE: A Long-Horizon Agent in Minecraft with Why-Which Reasoning

arXiv:2606.12852v2 Announce Type: replace Abstract: Rapid advances have been made in developing general-purpose embodied agent in environments like Minecraft through the adoption of LLM-augmented hier

Autonomous Research for Open-Ended Problems: A Case Study on Telecom Ticket Retrieval

arXiv:2609.13073v1 Announce Type: cross Abstract: Recent breakthroughs in LLM-based systems and their abilities in problem solving and coding have allowed progress in the AI for Science paradigm, pote

agentsarxiv-cs-lg

14 Sept 2026

CueMem: Cue-Guided Context Reconstruction for Long-Term Conversational Memory

arXiv:2609.12354v1 Announce Type: new Abstract: Long-term conversational agents must answer user queries by recalling information from extended dialogue histories, yet directly using the full history

14 Sept 2026

Hardware

Dynamic Expert Quantization for Scalable Mixture-of-Experts Inference