Search: “inference”

arXiv:2610.04801v1 Announce Type: cross Abstract: A useful model of AI inference infrastructure must specify the system state, the information available to an observer, and the decisions the model is

safetyarxiv-cs-lg

Tutorials

Diffusion Transformers are Provably Optimal In-context Generators

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

DGX agent

arXiv:2610.05333v1 Announce Type: new Abstract: Generative foundation models are attracting interest for their ability to produce desired outputs from demonstrations given at inference time, without u

tutorialsarxiv-cs-lg

6 Oct 2026

Learning Interpretable Differentiable Logic Networks for Tabular Regression

arXiv:2505.23615v2 Announce Type: replace Abstract: Neural networks (NNs) achieve outstanding performance in many domains; however, their decision processes are often opaque and their inference can be

LinearPFN: Amortized Variable Selection for Linear Models with Interactions

arXiv:2610.06580v1 Announce Type: new Abstract: Spike-and-slab regression is a standard Bayesian formulation of variable selection: it returns a posterior distribution over which candidate effects are

MultiLoc: Look Around As You Localize for Fast And Robust Visual Re-localization

model-releasesarxiv-cs-cv

arXiv:2603.27170v2 Announce Type: replace Abstract: Relative camera pose is a basic geometric cue for visual re-localization and scene understanding. When using images alone, visual evidence may not s

OVAL: Output-Aware Local Page Bases for KV Cache Retrieval

arXiv:2610.06686v1 Announce Type: new Abstract: Long context inference with large language models becomes increasingly expensive as attention must operate over an ever growing KV cache. Page sparse at

Applications

When and What to Prune? Stage-Aware Visual Token Pruning for Efficient VLA

arXiv:2610.05273v1 Announce Type: new Abstract: Visual token pruning is an effective way to accelerate vision-language models and is especially useful for vision-language-action (VLA) inference, where

applicationsarxiv-cs-cv

Applications

16-bit Precision of Convolutional Neural Networks on Microcontroller Units for 8-bit Costs

arXiv:2610.03402v1 Announce Type: new Abstract: To deploy deep neural networks on edge hardware, highly efficient inference schemes are necessary that retain high accuracy. This work presents W16A16,

applicationsarxiv-cs-lg

Activation Sparsity with Weight Approximation for Faster LLM Decoding on Offloaded Weights

arXiv:2610.02598v1 Announce Type: new Abstract: Deploying LLMs on consumer-grade GPUs with insufficient memory to hold their weights can result in prohibitively slow inference, because decoding repeat

local-aiarxiv-cs-lg

AI-driven Thermal-aware Data Center Capacity Planning

arXiv:2610.02442v1 Announce Type: new Abstract: The emerging of large language models (LLMs) has posed significant challenges to the thermal management of data center. Intense GPU computation for LLMs

local-aiarxiv-cs-lg

Consecutive Posterior Fusion for Diffusive Recovery of Unobservable Image Structures

arXiv:2610.03261v1 Announce Type: cross Abstract: Solving severely ill-posed imaging inverse problems requires recovering image structures that are unobservable or weakly constrained by the measuremen

Contextual Flow Matching: Adaptive Step Selection in Flow Models for Efficient Visual Generation

arXiv:2610.03202v1 Announce Type: cross Abstract: Flow Matching enables high-quality visual generation via continuous-time dynamics, but inference remains costly due to multiple sequential function ev

Deep Bayesian REFoCUS

arXiv:2610.03419v1 Announce Type: new Abstract: In this work we formulate ultrasound multistatic recovery from arbitrary transmit sequences as a Bayesian inference problem. To that end, we train a dee

From Patching to Pruning Visual Computation in Vision Language Models

arXiv:2610.03389v1 Announce Type: new Abstract: Vision language models (VLMs) incur substantial inference cost because every visual token is processed by the attention and MLP projections of every dec

researcharxiv-cs-cv

Lightweight and Resource-Efficient Perception for Robotic Guide Dogs

arXiv:2610.03187v1 Announce Type: cross Abstract: Multi-camera streaming perception is increasingly deployed on heterogeneous edge platforms shared with co-resident workloads, yet accelerator placemen

hardwarearxiv-cs-cv

Refinement Buys Intelligibility, Search Buys Identity: What Test-Time Compute Buys in Masked-Diffusion TTS

arXiv:2610.03320v1 Announce Type: new Abstract: Diffusion language models for text-to-speech combine two forms of computation: model depth (parameters) and refinement steps (inference budget). We ask

SpectralCache: Accelerating Diffusion-Based World Models via Spectral Feature Caching

arXiv:2610.02660v1 Announce Type: new Abstract: Diffusion-based world models enable high-quality interactive environment generation but suffer from substantial inference overhead due to repeated Trans

researcharxiv-cs-cv

Do Vision Language Models Understand Human Engagement in Games?

arXiv:2603.18480v2 Announce Type: replace-cross Abstract: Inferring human engagement from gameplay video is important for game design and player-experience research, yet it remains unclear whether vis

2 Oct 2026

RACE: Residual-Aware Test-Time Adaptation for Neighbor-Rich Time-Series Foundation Model Forecasting

arXiv:2610.00405v1 Announce Type: new Abstract: Time-series foundation models (TSFMs) perform strongly across forecasting tasks, but their per-series inference is ill-suited to neighbor-rich forecasti

2 Oct 2026

DynaFlow: Transparent and Flexible Intra-Device Parallelism via Programmable Operator Scheduling

arXiv:2605.21603v1 Announce Type: cross Abstract: Intra-device parallelism addresses resource under-utilization in ML inference and training by overlapping the execution of operators with different re

hardwarearxiv-cs-lg

Efficient Expert-Parallel Communication on PCIe-Connected Consumer GPUs

arXiv:2609.40093v1 Announce Type: cross Abstract: Expert parallelism (EP) enables inference of large Mixture-of-Experts (MoE) models by placing their experts across multiple GPUs, but requires substan

hardwarearxiv-cs-lg

FlexRouter: Learning Complementary Model Sets for Flexible LLM Routing

arXiv:2609.38585v1 Announce Type: cross Abstract: Existing Large Language Model (LLM) routing methods score LLMs independently to select top-k models. However, this ignores model correlations and enfo

Tutorials

Hermes: Learning Contextual Reasoning Unlocks Test-Time Scaling

arXiv:2609.38332v1 Announce Type: cross Abstract: Test-time scaling improves model performance by allocating additional compute during inference. Using this compute effectively across multiple context

tutorialsarxiv-cs-ai

MoEless: Efficient MoE LLM Serving with Serverless Experts

arXiv:2603.06350v2 Announce Type: replace-cross Abstract: Large Language Models (LLMs) increasingly adopt Mixture-of-Experts (MoE) architectures to scale efficiently under stringent resource constrain

local-aiarxiv-cs-ai

On the Relaxation of Conditional Independence Assumption for Image Segmentation

arXiv:2609.38930v1 Announce Type: cross Abstract: In semantic segmentation, a recent line of RankSEG methods directly optimizes Dice/IoU scores at inference time, improving alignment with evaluation m

local-aiarxiv-cs-ai

Parameter symmetries determine representational geometry in overparameterized nonlinear networks

arXiv:2609.39078v1 Announce Type: new Abstract: Representations are routinely used across machine learning, psychology, and neuroscience to draw inferences about the computations of biological and art

QATFactory: A Versatile, Deployment-Aligned Framework for Quantization-aware Training and Distillation of LLMs

arXiv:2609.39223v1 Announce Type: new Abstract: Large language model (LLM) inference is increasingly moving toward lower precision to realize the throughput of hardware accelerators, but aggressive po

Social Choice Foundations for Simulation-Augmented Generation

arXiv:2609.38287v1 Announce Type: cross Abstract: Simulation-augmented generation (SAGE) is a recent technical proposal in which models simulate individuals' viewpoints at inference time in order to p

Taming Speculative Search for Test-Time Scaling in LLM Serving

arXiv:2609.39334v1 Announce Type: cross Abstract: Test-time scaling has recently emerged as a powerful approach for improving LLM reasoning by allocating additional computation during inference, subst

researcharxiv-cs-cl

Towards Better Exploration in Sequential Test-Time Scaling

arXiv:2609.39632v1 Announce Type: new Abstract: Test-time scaling improves language model reasoning by spending additional compute at inference. However, both classes of existing methods often fail to

AdaptArena: Evaluating Test-Time Personalization of Web Agents

arXiv:2609.36488v1 Announce Type: new Abstract: Large language model (LLM) agents have demonstrated strong performance on complex web navigation tasks, yet they remain brittle in real-world settings w

30 Sept 2026

Neural Structural Reasoner: A Brain-inspired Architecture for Reasoning over Structured Knowledge

arXiv:2609.36620v1 Announce Type: new Abstract: Structural reasoning, the ability to recognize and make inferences over the relational structure between objects and concepts, is a hallmark of human co

30 Sept 2026

Applications

Urgent Actions Go First: Urgency-Aware Denoising for Real-Time VLA Control

arXiv:2609.37772v1 Announce Type: new Abstract: Diffusion and flow-matching Vision-Language-Action (VLA) policies generate action chunks through iterative denoising, incurring substantial inference la

applicationsarxiv-cs-ro

30 Sept 2026

Leveraging Soft Prompts for Privacy Attacks in Federated Prompt Tuning

arXiv:2601.06641v3 Announce Type: replace Abstract: Membership inference attacks (MIAs) pose a serious privacy threat in federated learning (FL). While MIAs have been extensively studied in standard F

NOSA: Native and Offloadable Sparse Attention

arXiv:2510.13602v3 Announce Type: replace-cross Abstract: Decoding throughput improvements from larger inference batches are limited by GPU memory, which is largely consumed by the key-value (KV) cach

hardwarearxiv-cs-lg

Recovery-Directed Symbolic Distillation of Neural Likelihoods

arXiv:2609.32409v1 Announce Type: new Abstract: Amortized neural likelihoods enable computationally expensive inference for models with analytically intractable or unspecified likelihoods, but their b

Still There, No Longer Seen: Exposing Compression-Induced Risk in Large Vision-Language Models

arXiv:2609.35002v1 Announce Type: new Abstract: Visual token compression reduces the inference cost of Large Vision-Language Models (LVLMs). However, aggregate robustness measures do not reveal whethe

researcharxiv-cs-cv

ThinkNet: Compact Architecture Selection and Validation-Gated Ensembles for Subject-Independent MI-EEG Decoding

arXiv:2609.33967v1 Announce Type: cross Abstract: Practical assistive and rehabilitative brain--computer interfaces require subject-independent motor-imagery EEG (MI-EEG) decoders that generalize to n

Uncertainty Quantification in Cardiac Model Personalisation from Ultrafast Ultrasound

arXiv:2609.35214v1 Announce Type: cross Abstract: Cardiac model personalisation requires inferring mechanical parameters that are not directly measurable in vivo. Ultrafast ultrasound shear wave elast

Learning coarse-step dynamics and internal mechanical response with graph networks

arXiv:2609.30344v1 Announce Type: new Abstract: Modern sensing records the motion of physical systems, but often leaves the forces and mechanical response governing that motion unobserved. Inferring t

Safety

Learning to Bias: Machine Learning-Enhanced Particle Filters

arXiv:2609.30498v1 Announce Type: new Abstract: Sequential inference estimates latent states from noisy and incomplete observations. Particle Filters (PFs), a class of Monte Carlo methods based on imp

safetyarxiv-cs-lg

Learning to Replace MCMC in Split-Gibbs Diffusion Posterior Sampling via Deep Unfolding

arXiv:2609.30539v1 Announce Type: cross Abstract: Split Gibbs sampling enables diffusion posterior inference for general nonlinear inverse problems by decoupling prior and likelihood computations, all

Learning to Stop without Learning to Stop: Self-Supervised Confidence Training Improves Reasoning Efficiency

arXiv:2609.31619v1 Announce Type: new Abstract: Reasoning models often generate very long reasoning traces, making inference computationally expensive. Existing approaches typically improve efficiency

LocUS: Head Selection and Subspace Projection for Targeted Activation Steering

arXiv:2609.31122v1 Announce Type: new Abstract: Activation steering is a powerful training-free paradigm for controlling large language models at inference time. However, standard approaches estimate

local-aiarxiv-cs-cl

The KV Cache Is the New Memory Wall

arXiv:2609.30854v1 Announce Type: cross Abstract: Autoregressive LLM inference at long context is bounded by memory bandwidth, not arithmetic throughput, and the binding resource shifts from model wei

The Price of Thought: Does Test-Time Reasoning Pay in LLM Trading?

arXiv:2609.30705v1 Announce Type: new Abstract: While inference-time reasoning in large language models (LLMs) promises better decision making, its higher computational cost may not yield better econo

Tutorials

Streaming-WAM: Action-Conditioned World-Action Model for Asynchronous Robot Manipulation

arXiv:2609.28927v1 Announce Type: new Abstract: World action models (WAMs) that use future visual prediction at inference time incur substantial generation costs. Asynchronous execution reduces waitin

tutorialsarxiv-cs-ro

25 Sept 2026

Phonemizing User-Generated Text: A Benchmark, Taxonomy, and Compositional Approach

arXiv:2609.27205v1 Announce Type: cross Abstract: Text-to-speech systems increasingly process user-generated text (UGT) such as ppl and imo, whose pronunciation must be inferred from the canonical rat