Search: “inference”

Tracing the ongoing emergence of human-like reasoning in Large Language Models

arXiv:2605.21299v1 Announce Type: new Abstract: Humans effortlessly go beyond literal meanings: If you mow the lawn, I will give you fifty dollars, is typically understood as implying that the speaker

researcharxiv-cs-cl

21 May 2026

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Safety

Trusted Weights, Treacherous Optimizations? Optimization-Triggered Backdoor Attacks on LLMs

DGX agent

arXiv:2605.20641v1 Announce Type: cross Abstract: Inference optimization is a vital technique for deploying LLMs at scale. Compilation is the most widely adopted optimization technique for LLMs. While

safetyarxiv-cs-lg

21 May 2026

UniT: Unified Geometry Learning with Group Autoregressive Transformer

arXiv:2605.21131v1 Announce Type: new Abstract: Recent feed-forward models have significantly advanced geometry perception for inferring dense 3D structure from sensor observations. However, its essen

researcharxiv-cs-cv

21 May 2026

Industry

Announcing OpenAI-compatible API support for Amazon SageMaker AI endpoints

Today, Amazon SageMaker AI introduces OpenAI-compatible API support for real-time inference endpoints. If you use the OpenAI SDK, LangChain, or Strands Agents, you can now invoke models on SageMaker A

industryaws-ml-blog

b9253

local-aillama-cpp-releases

b9253 is the latest version of llama.cpp, released on May 20, 2026. Llama.cpp is a project for LLM inference in C/C++. This build includes bug fixes, performance improvements, and features for running

Directed Acyclic Graph Convolutional Networks

arXiv:2506.12218v2 Announce Type: replace-cross Abstract: Directed acyclic graphs (DAGs) are central to science and engineering applications including causal inference, scheduling, and neural architec

safetyarxiv-cs-lg

Distribution-Free Uncertainty Quantification for Continuous AI Agent Evaluation

arXiv:2605.19779v1 Announce Type: new Abstract: We adapt split conformal prediction and adaptive conformal inference (ACI) to continuous AI agent evaluation, providing distribution-free coverage guara

Draft Less, Retrieve More: Hybrid Tree Construction for Speculative Decoding

arXiv:2605.20104v1 Announce Type: cross Abstract: Speculative decoding (SD) accelerates large language model inference by leveraging a draft-then-verify paradigm. To maximize the acceptance rate, rece

Exploring and Developing a Pre-Model Safeguard with Draft Models

arXiv:2605.19321v1 Announce Type: cross Abstract: Large Language Model (LLM) alignment remains vulnerable to jailbreak attacks that elicit unsafe responses, motivating pre-model and post-model guards.

FlexDraft: Flexible Speculative Decoding via Attention Tuning and Bonus-Guided Calibration

arXiv:2605.20022v1 Announce Type: new Abstract: Speculative decoding accelerates memory-bound LLM inference without quality degradation by using a fast drafter to propose multiple candidate tokens and

researcharxiv-cs-cl

From Sparsity to Simplicity: Enabling Simpler Sequential Replacements via Sparse Attention Distillation

arXiv:2605.18865v1 Announce Type: cross Abstract: Self-attention serves as the core foundation of large-scale transformer pretraining, but its quadratic token interaction cost makes inference expensiv

Agents

Hybrid Training for Vision-Language-Action Models

arXiv:2510.00600v2 Announce Type: replace-cross Abstract: Using Large Language Models to produce intermediate thoughts, a.k.a. Chain-of-thought (CoT), before providing an answer has been a successful

agentsarxiv-cs-ai

KVBuffer: IO-aware Serving for Linear Attention

arXiv:2605.19049v1 Announce Type: cross Abstract: Linear attention has recently gained significant attention for long-context inference due to its constant decoding cost with respect to context length

MO-CAPO: Multi-Objective Cost-Aware Prompt Optimization

arXiv:2605.18869v1 Announce Type: cross Abstract: Large language models (LLMs) achieve strong performance across a wide range of tasks but are highly sensitive to prompt design, motivating the need fo

Not all uncertainty is alike: volatility, stochasticity, and exploration

arXiv:2605.19215v1 Announce Type: new Abstract: Adaptive decision-making in biological and artificial intelligence requires balancing the exploitation of known outcomes with the exploration of uncerta

The impact of observation density on Bayesian inversion of latent dynamics in shock-dominated flows

arXiv:2605.19076v1 Announce Type: new Abstract: Inferring unknown initial states in shock-dominated compressible flows from sparse and noisy measurements is a challenging ill-posed inverse problem due

researcharxiv-cs-lg

Theory-optimal Quantization Based on Flatness

arXiv:2605.18800v1 Announce Type: cross Abstract: Post-training quantization has emerged as a widely adopted technique for compressing and accelerating the inference of Large Language Models (LLMs). T

Thinking in Scales: Accelerating Gigapixel Pathology Image Analysis via Adaptive Continuous Reasoning

arXiv:2605.19491v1 Announce Type: new Abstract: Traditional whole slide image (WSI) analysis methods typically rely on the multiple instance learning (MIL) paradigm, which extracts patch-level feature

local-aiarxiv-cs-cv

Understanding and Exploiting Weight Update Sparsity for Communication-Efficient Distributed RL

arXiv:2602.03839v2 Announce Type: replace Abstract: Bandwidth-constrained distributed reinforcement learning (RL) post-training of large language models is bottlenecked by two channels: weight synchro

local-aiarxiv-cs-lg

Agents

When Skills Don't Help: A Negative Result on Procedural Knowledge for Tool-Grounded Agents in Offensive Cybersecurity

arXiv:2605.20023v1 Announce Type: new Abstract: Agent Skills, structured packages of procedural knowledge loaded into an LLM agent at inference time, are widely reported to improve task pass rates by

agentsarxiv-cs-ai

Beyond the Cartesian Illusion: Testing Two-Stage Multi-Modal Theory of Mind under Perceptual Bottlenecks

arXiv:2605.18194v1 Announce Type: new Abstract: While Multi-Modal Large Language Models (MLLMs) demonstrate impressive capabilities in general reasoning, their embodied spatial intelligence remains ha

CheckSupport: A Local LLM-Powered Tool for Automated Manuscript Submission Checklist Selection and Completion

arXiv:2605.16377v1 Announce Type: cross Abstract: Transparent and standardized reporting is essential for reproducible scientific research, yet adherence to reporting guidelines remains inconsistent b

Controlla: Learning Controllability via Graph-Constrained Latent Geometry

model-releasesarxiv-cs-cv

arXiv:2605.16603v1 Announce Type: new Abstract: Controllable multimodal generation is commonly formulated as an inference-time conditioning problem using prompts, guidance, or auxiliary modules. While

Counterparty Modeling is Not Strategy: The Limits of LLM Negotiators

arXiv:2605.16575v1 Announce Type: new Abstract: Negotiation requires more than inferring what the other side wants: it requires using that information to make advantageous offers and counteroffers ove

Dynamic Elliptical Graph Factor Models via Riemannian Optimization with Geodesic Temporal Regularization

model-releasesarxiv-cs-lg

arXiv:2605.18316v1 Announce Type: new Abstract: Inferring time-varying graph structures from high-dimensional nodal observations is a fundamental problem arising in neuroscience, finance, climatology,

Applications

Dynamics of collective creativity in AI art competitions

arXiv:2605.17141v1 Announce Type: new Abstract: Creativity is a fundamental aspect of how culture evolves, yet the mechanisms by which groups produce novelty are notoriously difficult to infer from th

applicationsarxiv-cs-ai

Tutorials

Encoding Robust Topological Signatures for Hyperdimensional Computing

arXiv:2605.16785v1 Announce Type: cross Abstract: Hyperdimensional (HD) computing offers an attractive alternative to deep networks for edge learning due to its simplicity, fast prototype-based infere

tutorialsarxiv-cs-ai

EveryQuery: Zero-Shot Clinical Prediction via Task-Conditioned Pretraining over Electronic Health Records

arXiv:2603.07900v2 Announce Type: replace Abstract: Foundation models pretrained on electronic health records (EHR) have demonstrated zero-shot clinical prediction capabilities by generating synthetic

Fast Kernel-Space Diffusion for Remote Sensing Pansharpening

model-releasesarxiv-cs-cv

arXiv:2505.18991v3 Announce Type: replace Abstract: Pansharpening seeks to fuse high-resolution panchromatic (PAN) and low-resolution multispectral (LRMS) images into a single image with both fine spa

Geometry-Aware Attention Guidance for Diffusion Models via Modern Hopfield Dynamics

arXiv:2603.02531v2 Announce Type: replace-cross Abstract: Classifier-Free Guidance (CFG) improves sample quality in diffusion models, but its dual-pass inference and reliance on null-condition trainin

Global Prior Meets Local Consistency: Dual-Memory Augmented Vision-Language-Action Model for Efficient Robotic Manipulation

arXiv:2602.20200v2 Announce Type: replace-cross Abstract: Hierarchical Vision-Language-Action (VLA) models have rapidly become a dominant paradigm for robotic manipulation. It typically comprising a V

HierEdit: Region-Aware Hierarchical Diffusion for Efficient High-Resolution Editing

arXiv:2605.17294v1 Announce Type: new Abstract: High-resolution image editing is essential for professional and creative applications, yet existing multimodal diffusion-based editors remain computatio

local-aiarxiv-cs-cv

How Many Visual Tokens Do Multimodal Language Models Need? Scaling Visual Token Pruning with F^3A

arXiv:2605.16359v1 Announce Type: cross Abstract: Vision-language models improve perception by feeding increasingly long visual token sequences into language backbones, but the resulting inference cos

Internalizing Tool Knowledge in Small Language Models via QLoRA Fine-Tuning

model-releasesarxiv-cs-cl

arXiv:2605.17774v1 Announce Type: new Abstract: Large language models are increasingly used as planning components in agentic systems, but current tool-use pipelines often require full tool schemas to

Hardware

LEAP: Learnable End-to-End Adaptive Pruning of Large Language Models

arXiv:2605.17289v1 Announce Type: cross Abstract: Unstructured sparsity is now natively accelerated by recent GPU kernels and dataflow hardware, shifting the bottleneck from inference execution to the

hardwarearxiv-cs-ai

Tutorials

Leveraging Latent Visual Reasoning in Silence

arXiv:2605.18641v1 Announce Type: new Abstract: Latent visual reasoning involves visual evidence more directly in multimodal reasoning by inserting continuous latent tokens before textual generation.

tutorialsarxiv-cs-cv

On the Adversarial Robustness of Large Vision-Language Models under Visual Token Compression

arXiv:2601.21531v2 Announce Type: replace-cross Abstract: Visual token compression is widely used to accelerate large vision-language models (LVLMs) by pruning or merging visual tokens, yet its advers

Prompt Compression in Diffusion Large Language Models: Evaluating LLMLingua-2 on LLaDA

arXiv:2605.17932v1 Announce Type: cross Abstract: Prompt compression reduces inference cost and context length in large language models, but prior evaluations focus primarily on autoregressive archite

Reasoning as Compression: Unifying Budget Forcing via the Conditional Information Bottleneck

arXiv:2603.08462v2 Announce Type: replace Abstract: ac{CoT} prompting improves LLM accuracy on complex tasks but often increases token usage and inference cost. Existing ``Budget Forcing'' methods red

researcharxiv-cs-lg

Reliability and Effectiveness of Autonomous AI Agents in Supply Chain Management

arXiv:2605.17036v1 Announce Type: new Abstract: This paper studies autonomous generative AI agents in multi-echelon supply chains using the MIT Beer Game. We identify four inference-time levers that s

SafeLens: Deliberate and Efficient Video Guardrails with Fast-and-Slow Screening

model-releasesarxiv-cs-cl

arXiv:2605.17610v1 Announce Type: cross Abstract: The rapid growth of online video platforms and AI-generated content has made reliable video guardrails a key challenge for safety and real-world deplo

Sparse-to-Dense: A Free Lunch for Lossless Acceleration of Video Understanding in LLMs

arXiv:2505.19155v2 Announce Type: replace-cross Abstract: Due to the auto-regressive nature of current video large language models (Video-LLMs), the inference latency increases as the input sequence l

researcharxiv-cs-cl

Spiker-LL: An Energy-Efficient FPGA Accelerator Enabling Adaptive Local Learning in Spiking Neural Networks

arXiv:2605.18003v1 Announce Type: cross Abstract: Deploying adaptive intelligence at the edge remains challenging due to the high computational and energy cost of training neural models. Spiking Neura

Hardware

Stable Audio 3

arXiv:2605.17991v1 Announce Type: cross Abstract: Stable Audio 3 is a family of fast latent diffusion models (small, medium, large) for variable-length audio generation and editing. Since our models c

hardwarearxiv-cs-ai

Strategic Over-Parameterization for Generalizable Low-Rank Adaptation

arXiv:2605.16470v1 Announce Type: cross Abstract: Adapting large language models (LLMs) to downstream tasks via full fine-tuning is increasingly impractical due to its computational and memory demands

SwordBench: Evaluating Orthogonality of Steering Image Representations

arXiv:2605.16372v1 Announce Type: cross Abstract: Steering or intervening on model representations at inference time to correct predictions is essential for AI interpretability and safety, yet existin

Universal Inverse Distillation for Matching Models with Real-Data Supervision (No GANs)

arXiv:2509.22459v4 Announce Type: replace-cross Abstract: While achieving exceptional generative quality, modern diffusion, flow, and other matching models suffer from slow inference, as they require

researcharxiv-cs-lg

Unlocking the Potential of Diffusion Language Models through Template Infilling

arXiv:2510.13870v3 Announce Type: replace-cross Abstract: Diffusion Language Models (DLMs) have emerged as a promising alternative to Autoregressive Language Models, yet their inference strategies rem