Search: “inference”

Inference and Uncertainty Quantification for Streaming r-PCA

arXiv:2608.18374v1 Announce Type: cross Abstract: We address two open questions in streaming PCA via Oja's algorithm: sharp operator-norm convergence for general rank under sub-Gaussian data, and dist

20 Aug 2026

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Pretraining Reusable Inference Across Views with Synthetic Task Priors

DGX agent

arXiv:2608.19115v1 Announce Type: new Abstract: Modern pretrained encoders make representations from heterogeneous views increasingly reusable, but the procedure that determines view utility and combi

safetyarxiv-cs-lg

20 Aug 2026

Agents

Training-Free Inference-Time Self-Reflection and Cost-Bounded Early Stopping for Large Language Models

arXiv:2608.18884v1 Announce Type: new Abstract: Reinforcement-learning training of reasoning LLMs (e.g., GRPO) is expensive and requires a controllable environment, committing every contribution to a

agentsarxiv-cs-ai

20 Aug 2026

From LLM Inference to Agentic Workloads: Characterization and Implications for Serving Systems

model-releasesarxiv-cs-ai

arXiv:2608.15127v1 Announce Type: cross Abstract: Agentic applications are shifting AI serving from isolated model inference to long-running workloads in which LLMs coordinate tools, environments, and

18 Aug 2026

Towards a theory of inference-time alignment with unknown rewards

arXiv:2608.15402v1 Announce Type: new Abstract: Generative model alignment has received broad interest, and significant progress has been made in supervised fine-tuning and inference-time computation.

safetyarxiv-cs-lg

18 Aug 2026

SPADE: Speculative Decoding for Precise and Low Cost Distributed Edge Cloud Inference

arXiv:2608.13076v1 Announce Type: new Abstract: Large Language Models (LLMs) have achieved remarkable success in natural language understanding and generation, but their deployment is constrained by h

applicationsarxiv-cs-ai

14 Aug 2026

User-Assisted Collaborative Distributed Inference for Efficient QoS-Aware Autoscaling

arXiv:2608.11840v1 Announce Type: cross Abstract: Growing demand for artificial intelligence (AI) inference services requires scalable infrastructure, yet centralized serving costs rise with demand. W

13 Aug 2026

CARB: A Characterization-Guided Framework for CNN Inference Cost Prediction and Deployment Screening

arXiv:2608.10506v1 Announce Type: cross Abstract: Accurate pre-deployment estimation of CNN inference cost--energy, latency, and peak memory--is increasingly critical as models are deployed on resourc

hardwarearxiv-cs-lg

12 Aug 2026

Demystifying Prediction Powered Inference

arXiv:2601.20819v2 Announce Type: replace-cross Abstract: Machine learning predictions are increasingly used to supplement incomplete or costly-to-measure outcomes in fields such as biomedical researc

safetyarxiv-cs-lg

11 Aug 2026

Depth-adaptive Inference of Looped Language Models via Continuous Depth Batching

arXiv:2608.09444v1 Announce Type: cross Abstract: A main promise of looped language models (LMs) is depth-adaptive inference. By iterating a block of shared layers a variable number of times, the mode

hardwarearxiv-cs-cl

11 Aug 2026

On the Effect of Sampling Diversity in Scaling LLM Inference

arXiv:2502.11027v5 Announce Type: replace Abstract: Large language model (LLM) scaling inference is key to unlocking greater performance, and leveraging diversity has proven an effective way to enhanc

11 Aug 2026

Mind the Gap: A Dual Knowledge Graph Framework for Unified Multi-task User Intent Inference

arXiv:2608.06752v1 Announce Type: new Abstract: This paper proposes DKG-MTI, a dual knowledge graph framework for unified multi-task user intent inference from online travel reviews. Existing approach

safetyarxiv-cs-ai

10 Aug 2026

Tutorials

Analogy as Nonparametric Bayesian Inference over Relational Systems

arXiv:2006.04156v2 Announce Type: replace Abstract: Our inferences in the real world are rarely naive - we acquire experiences through our lifetime that can help us more quickly understand the structu

tutorialsarxiv-cs-ai

7 Aug 2026

PriDyG: Privacy-preserving Dynamic Graph Inference with LLM-GNN Collaboration

arXiv:2608.04255v1 Announce Type: cross Abstract: Graph inference over relational data can expose sensitive edge information, and this risk becomes more severe in dynamic graphs, where repeated model

6 Aug 2026

Local Ai

Celty: SpMspV GPU Kernel and SIMT Co-Design for Efficient Dual-Sparse LLM Inference

arXiv:2608.01536v1 Announce Type: cross Abstract: Large Language Models (LLMs) increasingly rely on sparsity to reduce inference cost, but most prior work targets a single sparsity source-either weigh

local-aiarxiv-cs-lg

4 Aug 2026

HetRoute Heterogeneous and Cost-aware Collaborative Routing Framework for Distributed Edge MoE Inference

arXiv:2608.00577v1 Announce Type: cross Abstract: Mixture-of-Experts (MoE) models have become a dominant architecture for large-scale AI services, yet deploying them over geo-distributed heterogeneous

hardwarearxiv-cs-cl

4 Aug 2026

Neural Surrogate HMC: On Using Neural Likelihoods for Hamiltonian Monte Carlo in Simulation-Based Inference

arXiv:2407.20432v3 Announce Type: replace Abstract: Bayesian inference methods such as Markov Chain Monte Carlo (MCMC) typically require repeated computations of the likelihood function, but in some s

4 Aug 2026

Dynamic Parameterization Is Not Dynamic Inference

arXiv:2607.26192v1 Announce Type: new Abstract: Input-dependent controller coefficients are often treated as evidence of dynamic inference or computational savings. This interpretation conflates three

30 Jul 2026

AI-Assisted Causal Inference and Mediation Analyses of Environmental and Psychosocial Determinants of Subjective Cognitive Difficulties in the All of Us Research Program

arXiv:2607.22640v1 Announce Type: cross Abstract: Short-term environmental exposures have been linked to cognitive and behavioral outcomes, although many reported associations may reflect broader geog

28 Jul 2026

X-Stage: An Overlooked Pipeline Stage for Communication-Computation Overlap in DiT Inference

arXiv:2607.23264v1 Announce Type: cross Abstract: Fine-grained, device-initiated communication lets persistent GPU kernels in distributed diffusion transformer (DiT) inference issue remote stores and

hardwarearxiv-cs-ai

28 Jul 2026

Hierarchical Latent Structure Learning through Online Inference

arXiv:2603.19139v2 Announce Type: replace Abstract: Learning systems must balance generalization across experiences with discrimination of task-relevant details. Effective learning therefore requires

27 Jul 2026

Inference-Time Scaling of Diffusion Models via Progressive Seed Pruning

arXiv:2607.21591v1 Announce Type: new Abstract: Diffusion and flow-matching models dominate conditional image generation, yet inference-time scaling for these models is far less developed than for aut

safetyarxiv-cs-cv

24 Jul 2026

Strong Gravitational Lensing Posterior Sampling in Pixel-Space Using Diffusion Models and Recurrent Inference Machines

arXiv:2607.19459v1 Announce Type: cross Abstract: Modeling galaxy-galaxy strong gravitational lenses to infer the brightness of the source galaxy and the mass distribution of the foreground galaxy is

researcharxiv-cs-cv

23 Jul 2026

Full-Pipeline Inference Optimization for MiMo-V2.5 Series: Pushing Hybrid SWA Efficiency to the Limit

arXiv:2607.13095v1 Announce Type: cross Abstract: We present a full-pipeline inference optimization for the MiMo-V2.5 model family, which combines Hybrid Sliding Window Attention (Hybrid SWA), sparse

hardwarearxiv-cs-ai

16 Jul 2026

Decomposition for Bayesian Networks: Local and Parallel Inference

model-releasesarxiv-cs-lg

arXiv:2607.04650v1 Announce Type: cross Abstract: Probabilistic inference in high-dimensional Bayesian networks is difficult because exact manipulation of the joint distribution scales exponentially w

Local Ai

Elastic Gang: Per-Token Membership Change for a Hard-Barriered LLM Inference Gang Co-Scheduled with OS Processes

arXiv:2607.04668v1 Announce Type: cross Abstract: On-device LLM decoding is a hard-barriered CPU-SIMD computation that wants every core for milliseconds per token, while the rest of the OS wants those

local-aiarxiv-cs-ai

Layer-Parallel Inference Reduces Encrypted Nonlinear Depth in Transformers

arXiv:2607.04819v1 Announce Type: new Abstract: Fully homomorphic encryption (FHE) enables computation on encrypted data, but practical encrypted Transformer inference is bottlenecked by the sequentia

Transformers with Physics-Informed Encodings and Simulation-Based Inference for Robust Detection of Eccentric Binary Black Holes in Pulsar Timing Array Data

model-releasesarxiv-cs-lg

arXiv:2607.03904v1 Announce Type: new Abstract: Pulsar timing arrays (PTAs) provide a unique window into nanohertz gravitational waves (GWs), but extracting astrophysical parameters from noisy, long-b

Structured SIR: Efficient and Expressive Importance-Weighted Inference for High-Dimensional Image Registration

arXiv:2603.17415v2 Announce Type: replace-cross Abstract: Image registration is an ill-posed dense vision task, where multiple solutions achieve similar loss values, motivating probabilistic inference

researcharxiv-cs-cv

1 Jul 2026

The Speedup Paradox: Rethinking Inference Speed-Quality Trade-off in Embodied Tasks

arXiv:2606.28529v1 Announce Type: cross Abstract: Embodied foundation models have recently been widely used to improve robot generalization and task success rates. Previous works apply lossy efficient

30 Jun 2026

Simulation-based inference for rapid Bayesian parameter estimation in epidemiological models: a comparison with MCMC

model-releasesarxiv-cs-ai

arXiv:2606.27286v1 Announce Type: new Abstract: Mechanistic epidemiological models are widely used to support infectious disease forecasting and public-health decision making. Bayesian calibration of

26 Jun 2026

Brevity is the Soul of Inference Efficiency: Inducing Concision in VLMs via Data Curation

arXiv:2606.25432v1 Announce Type: cross Abstract: Inference efficiency is typically pursued by shrinking the model: distillation, pruning, quantization, and sparse routing each lower per-token cost wh

researcharxiv-cs-cv

25 Jun 2026

Expected Free Energy-based Planning as Variational Inference

arXiv:2606.20658v1 Announce Type: cross Abstract: Planning under uncertainty requires agents to balance goal achievement with information gathering. Active inference addresses this through the Expecte

safetyarxiv-cs-lg

23 Jun 2026

Local Ai

TileFuse: A Fused Mixed-Precision Kernel Library for Efficient Quantized LLM Inference on AMD NPUs

arXiv:2606.11357v1 Announce Type: cross Abstract: With the growing demand for on-device LLM inference, edge SoCs increasingly integrate NPUs to improve performance and energy efficiency under tight po

local-aiarxiv-cs-ai

11 Jun 2026

Foundation Inference Models for Ordinary Differential Equations

arXiv:2602.08733v2 Announce Type: replace Abstract: Ordinary differential equations (ODEs) are central to scientific modelling, but inferring their vector fields from noisy trajectories remains challe

9 Jun 2026

Ablation Study of Block Size, Weight Precision, and Scale Precision in NVFP4 Inference for Low-Power Edge-Efficient Neural Networks

arXiv:2606.06527v1 Announce Type: cross Abstract: Energy-efficient edge inference requires reducing arithmetic cost, memory traffic, and hardware overhead. This paper presents an ablation-focused stud

8 Jun 2026

Scalable Joint Resource Allocation for SLO-Constrained LLM Inference in Heterogeneous GPU Clouds

arXiv:2604.07472v2 Announce Type: replace Abstract: Serving large language model (LLM) inference in cloud environments requires jointly optimizing model selection, GPU provisioning, parallelism config

hardwarearxiv-cs-lg

8 Jun 2026

In-Context Graphical Inference

arXiv:2606.05042v1 Announce Type: cross Abstract: Marginal inference in discrete graphical models forces a choice between exactness and scalability: exact algorithms are intractable for high-treewidth

safetyarxiv-cs-cl

4 Jun 2026

Neural Galerkin Normalizing Flows for Bayesian Inference of Diffusions with Inaccessible Boundaries

model-releasesarxiv-cs-lg

arXiv:2606.04324v1 Announce Type: new Abstract: One of the primary challenges in Bayesian inference on the parameters of a diffusion model from discrete observations is the unavailability of an analyt

4 Jun 2026

FlashMLA-ETAP: Efficient Transpose Attention Pipeline for Accelerating MLA Inference on NVIDIA H20 GPUs

model-releasesarxiv-cs-ai

arXiv:2506.01969v3 Announce Type: replace-cross Abstract: Efficient inference of Multi-Head Latent Attention (MLA) is challenged by deploying the DeepSeek-R1 671B model on a single Multi-GPU server. T

3 Jun 2026

Extreme Low-Bit Inference in Reasoning Models: Failure Modes and Targeted Recovery

arXiv:2606.02011v1 Announce Type: new Abstract: Large Reasoning Models (LRMs) rely on long reasoning traces, making inference expensive. While low-bit quantization reduces per-token decoding cost, we

2 Jun 2026

Empirical Characterization of Inference-Time Elicited Probability Transformations in Large Language Models

arXiv:2603.19262v2 Announce Type: replace-cross Abstract: Large language models increasingly rely on inference-time procedures such as chain-of-thought reasoning, self-refinement, retrieval augmentati

1 Jun 2026

A Geometric View of SRC: Learning Representations for Stable Residual Inference

arXiv:2605.29673v1 Announce Type: cross Abstract: Reconstruction-based inference assigns a class by comparing class-wise reconstruction residuals; Sparse Representation Classification (SRC) is a canon

safetyarxiv-cs-cv

29 May 2026

Bridging Maximum Likelihood and Optimal Transport for Efficient Inference and Model Selection in Stochastic Block Models

arXiv:2605.28488v1 Announce Type: cross Abstract: We study inference in stochastic block models (SBMs) through the lens of optimal transport (OT). We first establish that maximum likelihood variationa

28 May 2026

Conceptual Schema Inference for Tabular Datasets using Large Language Models

arXiv:2509.04632v2 Announce Type: replace-cross Abstract: Large collections of tabular data from data lakes, web tables and open data portals often originate from heterogeneous sources, leading to rep

applicationsarxiv-cs-ai

27 May 2026

Greening AI Inference with Accuracy and Latency-aware User Incentives

arXiv:2605.27309v1 Announce Type: new Abstract: The widespread use of AI services has raised concerns for its environmental sustainability, towards which recent studies have identified carbon emission

27 May 2026

Membership Inference Risks in Quantized Models: A Theoretical and Empirical Study

arXiv:2502.06567v2 Announce Type: replace-cross Abstract: Quantizing machine learning models has demonstrated its effectiveness in lowering memory and inference costs while maintaining performance lev

applicationsarxiv-cs-lg

27 May 2026

Membership Inference Attacks on Tokenizers of Large Language Models