Search: “llm”

Orak: A Foundational Benchmark for Training and Evaluating LLM Agents on Diverse Video Games

arXiv:2506.03610v3 Announce Type: replace Abstract: Large Language Model (LLM) agents are reshaping the game industry, by enabling more intelligent and human-preferable characters. Yet, current game b

17 Apr 2026

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Research

XMark: Reliable Multi-Bit Watermarking for LLM-Generated Texts

DGX agent

arXiv:2604.05242v2 Announce Type: replace Abstract: Multi-bit watermarking has emerged as a promising solution for embedding imperceptible binary messages into Large Language Model (LLM)-generated tex

researcharxiv-cs-cl

17 Apr 2026

DeepTest Tool Competition 2026: Benchmarking an LLM-Based Automotive Assistant

arXiv:2604.12615v1 Announce Type: new Abstract: This report summarizes the results of the first edition of the Large Language Model (LLM) Testing competition, held as part of the DeepTest workshop at

15 Apr 2026

Tutorials

TimeSAF: Towards LLM-Guided Semantic Asynchronous Fusion for Time Series Forecasting

arXiv:2604.12648v1 Announce Type: cross Abstract: Despite the recent success of large language models (LLMs) in time-series forecasting, most existing methods still adopt a Deep Synchronous Fusion str

tutorialsarxiv-cs-ai

15 Apr 2026

Towards grounded autonomous research: an end-to-end LLM mini research loop on published computational physics

arXiv:2604.12198v1 Announce Type: cross Abstract: Recent autonomous LLM agents have demonstrated end-to-end automation of machine-learning research. Real-world physical science is intrinsically harder

15 Apr 2026

Agentic Video Generation: From Text to Executable Event Graphs via Tool-Constrained LLM Planning

arXiv:2604.10383v1 Announce Type: new Abstract: Existing multi-agent video generation systems use LLM agents to orchestrate neural video generators, producing visually impressive but semantically unre

safetyarxiv-cs-cv

14 Apr 2026

From Helpful to Trustworthy: LLM Agents for Pair Programming

arXiv:2604.10300v1 Announce Type: cross Abstract: LLM-based coding agents are increasingly used to generate code, tests, and documentation. Still, their outputs can be plausible yet misaligned with de

14 Apr 2026

Putting the Value Back in RL: Better Test-Time Scaling by Unifying LLM Reasoners With Verifiers

arXiv:2505.04842v2 Announce Type: replace-cross Abstract: Prevalent reinforcement learning~(RL) methods for fine-tuning LLM reasoners, such as GRPO or Leave-one-out PPO, abandon the learned value func

14 Apr 2026

Beyond Relevance: Utility-Centric Retrieval in the LLM Era

arXiv:2604.08920v1 Announce Type: cross Abstract: Information retrieval systems have traditionally optimized for topical relevance-the degree to which retrieved documents match a query. However, relev

13 Apr 2026

Structuring versus Problematizing: How LLM-based Agents Scaffold Learning in Diagnostic Reasoning

arXiv:2604.09158v1 Announce Type: cross Abstract: Supporting students in developing diagnostic reasoning is a key challenge across educational domains. Novices often face cognitive biases such as prem

13 Apr 2026

Initialisation Determines the Basin: Efficient Codebook Optimisation for Extreme LLM Quantization

arXiv:2604.08118v1 Announce Type: new Abstract: Additive quantization enables extreme LLM compression with O(1) lookup-table dequantization, making it attractive for edge deployment. Yet at 2-bit prec

JoyAI-LLM Flash: Advancing Mid-Scale LLMs with Token Efficiency

arXiv:2604.03044v2 Announce Type: replace-cross Abstract: We introduce JoyAI-LLM Flash, an efficient Mixture-of-Experts (MoE) language model designed to redefine the trade-off between strong performan

Rethinking Entropy Allocation in LLM-based ASR: Understanding the Dynamics between Speech Encoders and LLMs

arXiv:2604.08003v1 Announce Type: cross Abstract: Integrating large language models (LLMs) into automatic speech recognition (ASR) has become a dominant paradigm. Although recent LLM-based ASR models

SHAPE: Stage-aware Hierarchical Advantage via Potential Estimation for LLM Reasoning

arXiv:2604.06636v1 Announce Type: cross Abstract: Process supervision has emerged as a promising approach for enhancing LLM reasoning, yet existing methods fail to distinguish meaningful progress from

llm-wikikarpathyknowledge-base

Concepts

LLM Wiki

Human

Karpathy’s pattern: LLMs compile raw sources into a persistent interlinked markdown wiki—entity/concept pages, index, log—rather than re-deriving answers from RAG on every query.

4 Apr 2026

Are You Sure Your LLM Is Sure? Repairing and Auditing Confidence

arXiv:2610.22139v1 Announce Type: new Abstract: Confidence scores determine whether an LLM answer is accepted, reviewed, or regenerated, yet scalar recalibration can only correct errors visible throug

Human Interventions as Labels: Localizing, Steering, and (Sometimes) Editing the Computations Behind LLM Agent Failures

arXiv:2610.21708v1 Announce Type: cross Abstract: When an LLM agent misbehaves, a human steps in, and that intervention is usually discarded or replayed as training data. We treat it instead as a meas

Stronger Judges Do Not See More: Deployment-Integrity Blindness in LLM Evaluation

arXiv:2610.21135v1 Announce Type: cross Abstract: LLM-agent evaluation reports behavioral scores but leaves the identity of the deployed runtime stack unreported. A tampered deployment that preserves

WaveLLM: Wavelet-Domain LLM Entropy Modeling for Lossless Image Compression

model-releasesarxiv-cs-cv

arXiv:2610.22232v1 Announce Type: new Abstract: Lossless image compression fundamentally relies on accurate entropy modeling, driving a recent shift toward large language model (LLM)-based methods. Ho

From Unreliable to Usable: Decomposing Failure Modes and Confidence Signals in LLM Entity Extraction - Evidence from Cyber Threat Intelligence

arXiv:2610.20417v1 Announce Type: new Abstract: Audits of large language model (LLM) extraction from full-length documents report severe unreliability, leaving two questions open: what the failures ac

Iterative Critique-Refine Framework for Enhancing LLM Personalization

arXiv:2510.24469v2 Announce Type: replace-cross Abstract: Personalized text generation requires models not only to produce coherent text but also to align with a target user's style, tone, and topical

LaCache: Robust Semantic Caching for LLM Serving

arXiv:2608.01718v2 Announce Type: replace Abstract: Semantic caching, reusing responses to answer semantically similar queries, has seen growing adoption in LLM serving, offering faster responses and

Hardware

Stable Token-level Scheduling for Serverless LLM Inference

arXiv:2610.17689v1 Announce Type: new Abstract: Serverless inference is emerging as an efficient deployment model for Large Language Models (LLMs) due to its ability to elastically scale resources, im

hardwarearxiv-cs-ai

StableJudge: A Lightweight Adversarial Defense Framework for LLM-as-a-Judge

arXiv:2610.16814v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly used as judges to assign scalar scores that drive downstream decision-making, including tasks such as pa

Verification as an Architectural Layer for LLM Agents: A V-Model Design, and a Pilot Study of Its Deterministic Core

arXiv:2609.31937v2 Announce Type: replace-cross Abstract: Large language model (LLM) agents built on the ReAct pattern concentrate four responsibilities in one model: selecting a strategy, choosing ea

VibeServe: Can AI Agents Build Bespoke LLM Serving Systems?

arXiv:2605.06068v2 Announce Type: replace Abstract: For years, we have built LLM serving systems like any other critical infrastructure, with a single general-purpose stack hand-tuned over many engine

Auditing LLM Program Search for Bermudan Stopping with Primal--Dual Certificates

arXiv:2610.14063v1 Announce Type: new Abstract: LLM program-search agents are usually judged by the score that drives their search. We study LLM-driven search over Python exercise policies for Bermuda

safetyarxiv-cs-lg

Autoregressive Decoding as a Martingale: Characterizing the Stochastic Dynamics of LLM Generation

model-releasesarxiv-cs-lg

arXiv:2610.16041v1 Announce Type: new Abstract: Large language models (LLMs) have achieved remarkable success across a wide range of language tasks. At their core, autoregressive LLMs are conditional

Applications

Can We Trust This Evaluation? Instance-Level Reliability of LLM-as-a-Judge

arXiv:2610.14029v1 Announce Type: new Abstract: LLM-as-a-judge evaluation commonly aggregates multiple judges' decisions into a majority vote, yet this panel decision process does not guarantee that t

applicationsarxiv-cs-lg

Local Ai

MENTOR: Procedural Shielding of Tool-Using LLM Agents

arXiv:2610.17039v1 Announce Type: cross Abstract: Tool-using LLM agents are increasingly used to automate workflows governed by procedural manuals, such as company rules for booking travel or procurin

local-aiarxiv-cs-lg

TagBO: LLM-Driven Task-Aware Graph Bayesian Optimization for Scientific Discovery

arXiv:2610.14626v1 Announce Type: new Abstract: Mixed-variable optimization in scientific discovery often requires exploring large combinatorial spaces under costly experimental evaluations, making sa

researcharxiv-cs-lg

A 'free' multi-modal 'embedding' model (already) included with your LLM: vLLM plugin + upstream PR

model-releasesr-localllama

Disclaimer: I work for NuMind, the company behind this plugin. TLDR: Text/image (simili-)embeddings from the LLM you already have loaded :-) I've been working on making it easier to obtain embeddings

PreSTO: Predictive Subtree Prefetching for Fast LLM Power Sampling

arXiv:2610.13171v1 Announce Type: new Abstract: Power sampling improves large language model (LLM) reasoning at test time by sampling from a sharpened version of the base model's distribution. Its sam

researcharxiv-cs-cl

QTestBench: A Test Framework for Evaluating LLM-Generated Quantum Code

arXiv:2610.13811v1 Announce Type: cross Abstract: Large language models (LLMs) have shown strong results in classical code generation and are increasingly used to write the unit tests that safeguard t

VEPA: Verified Evolving Formal Policy for Lifelong LLM Agent Guardrails

arXiv:2610.12813v1 Announce Type: new Abstract: LLM agents increasingly operate over sensitive resources, such as private documents and mutable system states, which can create serious safety and secur

safetyarxiv-cs-ai

Black-Box Forensics for Conversational LLM Agents

arXiv:2606.22698v2 Announce Type: replace-cross Abstract: As LLM-powered scams proliferate, black-box forensics for conversational LLM agents offers a path to accountability for systems hidden behind

9 Oct 2026

Examining Social Attribution in LLM Reasoning: A Theory-Guided Probing Methodology

arXiv:2610.12022v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly deployed in sociotechnical systems where social attribution, the reasoning process attributing external

9 Oct 2026

Long Text to Predictive Features: LLM-Guided Blockwise Feature Engineering via Executable Program Search

arXiv:2610.12390v1 Announce Type: cross Abstract: Industrial risk-control systems typically rely on structured-data models for efficient prediction, yet substantial valuable information remains embedd

researcharxiv-cs-cl

9 Oct 2026

Conditional Accuracy Profiles: Diagnosing LLM Judges across Deployment Conditions

model-releasesarxiv-cs-lg

arXiv:2610.09229v1 Announce Type: new Abstract: LLM-as-judge is now a standard tool for scalable evaluation, but judge performance is still often summarized by a single accuracy number. This aggregate

8 Oct 2026

Agent in a Bottle: Can LLM Agents Turn Their Capabilities Into Cheap, Scalable Artifacts?

arXiv:2610.08775v1 Announce Type: new Abstract: Large language models (LLMs) can solve many narrow tasks, but querying them separately for millions of related instances can be prohibitively expensive.

CACHEFORGE: LLM-Guided End-to-End Generative Cache Replacement Policy for Performance and Hardware Efficiency

arXiv:2610.07668v1 Announce Type: cross Abstract: Modern cache replacement designs saturate because they operate within fixed representational structures, hand-crafted and heuristic based feature-engi

Detecting LLM-Assisted Vietnamese Writing via Keystrokes under Behavioral Manipulation

arXiv:2610.07700v1 Announce Type: new Abstract: We study the robustness of keystroke dynamics for detecting large language model (LLM)-assisted writing. We introduce a Vietnamese keystroke dataset cap

researcharxiv-cs-cl

MemCo: Memory-Centric Collaboration for Generalizing LLM Agents to Unseen Environments

arXiv:2610.07376v1 Announce Type: new Abstract: Large language model (LLM) agents increasingly operate in interactive environments, where they need to make sequential decisions through observation, ac

SchemaFill: Efficient LLM Tool Calling via Slot-Parallel Speculative Decoding

arXiv:2610.07086v1 Announce Type: cross Abstract: LLM agents interact with external systems by generating structured tool calls. Given a user request, conversational context, and a catalog of tool sch

Stabilizing Off-Policy Training for Long-Horizon LLM Agent via Turn-Level Importance Sampling and Clipping-Triggered Normalization

arXiv:2511.20718v3 Announce Type: replace-cross Abstract: Reinforcement learning (RL) algorithms such as PPO and GRPO are widely used to train large language models (LLMs) for multi-turn agentic tasks

safetyarxiv-cs-ai

Will the Judge Flip? Predicting Position-Sensitive LLM Judgments from Residual Stream Activations

arXiv:2610.07115v1 Announce Type: cross Abstract: The order in which candidate responses are presented can change an LLM judge's verdict. Detecting such a position flip ordinarily requires judging eac

WorldSolver: Can LLM Agents Simulate the Physical Dynamics via Solver Generation?

arXiv:2610.08720v1 Announce Type: new Abstract: LLM-based agents are increasingly advancing scientific and engineering problem solving, with physics simulation emerging as a challenging yet practical

AdaEva: Accelerating LLM-Driven Algorithm Design with Adaptive Partial Evaluation