Search: “inference”

Beyond Fresh Starts: Stateful Inference for Streaming ASR in Conversational Voice Agents

arXiv:2608.22101v1 Announce Type: new Abstract: Modern voice-agent systems rely on streaming speech recognition models that operate under stringent latency constraints. This study shows that, due to t

agentsarxiv-cs-lg

25 Aug 2026

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Research

Traceable Spectral Inference via Influence Functions: Efficient Data Attribution and Error Proxies for the Ariel Mission

DGX agent

arXiv:2608.23458v1 Announce Type: new Abstract: Interpretability is critical for machine learning models deployed in scientific space missions such as ESA's Ariel, where ground truth is unavailable du

researcharxiv-cs-lg

25 Aug 2026

Policy Optimization and Statistical Inference for Online Contextual Matrix Games

arXiv:2608.17173v1 Announce Type: cross Abstract: Online decision making often requires navigating a landscape shaped by both dynamic contexts and strategic interactions. In competitive pricing, for e

19 Aug 2026

SPSA Hyperparameter Tuning for Variational Quantum Natural Language Inference

arXiv:2608.16939v1 Announce Type: cross Abstract: Training variational quantum models requires choosing between parameter-shift gradients, which are exact but cost O(P) forward evaluations, and simult

19 Aug 2026

TileMix: Tile-Centric Mixed-Precision Attention for LLM Inference Acceleration

model-releasesarxiv-cs-ai

arXiv:2608.17336v1 Announce Type: new Abstract: Long-context prefill in large language models (LLMs) incurs substantial computation and memory traffic because dense self-attention computes quadratic q

19 Aug 2026

DriveCache: Action-Aware Caching for Driving World Model Inference

arXiv:2608.16354v1 Announce Type: new Abstract: Driving video generation models support autonomous-driving development by predicting controllable future scenes for simulation, planning evaluation, and

agentsarxiv-cs-ai

18 Aug 2026

Hardware

FluxBin: Flexible LUT-based Ultra-low-bit LLM Inference by Algorithm-Kernel Synergy

arXiv:2608.15602v1 Announce Type: cross Abstract: While binary quantization theoretically promises extreme compression and acceleration for Large Language Models (LLMs), existing research often overlo

hardwarearxiv-cs-ai

18 Aug 2026

Prediction Inference of Time Series with Standard ReLU Deep Neural Networks

arXiv:2608.15362v1 Announce Type: cross Abstract: We propose a methodology based on the standard ReLU Deep Neural Networks (DNN) to make predictions and quantify their uncertainty. Classically, people

18 Aug 2026

Discovering Efficient and Explainable Communication Topologies for LLM-based Multi-Agent Systems via Causal Inference

arXiv:2608.12921v1 Announce Type: cross Abstract: The performance of large language model (LLM)-based multi-agent systems (MAS) largely depends on effective communication topologies. Existing topology

agentsarxiv-cs-ai

14 Aug 2026

CORA-Diff: Confidence-Oriented Residual Acceptance for Efficient Diffusion Language Model Inference

arXiv:2608.11235v1 Announce Type: new Abstract: Diffusion language models (DLMs) update many tokens in parallel, yet practical decoders often use a fixed denoising horizon. Many predictions stabilize

13 Aug 2026

BRACE: Taming Sharp Irregularities via Barycentric Rational Forecasting for Fast Diffusion Transformers Inference

arXiv:2608.07572v1 Announce Type: cross Abstract: Diffusion Transformers (DiTs) have demonstrated exceptional performance in high-fidelity image and video generation. To alleviate their massive comput

Causal State-Space Model for Causal Inference: Estimating Longitudinal Individual Treatment Effects

arXiv:2608.08288v1 Announce Type: new Abstract: Estimating counterfactual outcomes over time from longitudinal observational data is central to clinical decision support. Existing methods rely on doma

Focus particles and scalar inferences across humans and language models

arXiv:2608.08227v1 Announce Type: new Abstract: Focus particles such as 'even' and 'only' are central to formal semantic theories that posit structured representations over sets of alternatives. 'Even

researcharxiv-cs-cl

Sparse corruption in low-rank matrix inference: the PCA benchmark

arXiv:2511.11927v2 Announce Type: replace-cross Abstract: Principal Component Analysis (PCA) is a standard tool for extracting a low-rank signal from noisy observations. It is known that applying PCA

SUMI: Scalable Unified Model for 3D Point Cloud Inference

arXiv:2608.08115v1 Announce Type: new Abstract: Point cloud completion commonly follows a coarse-to-fine paradigm, where a low-density coarse shape is first predicted and then upsampled to the target

researcharxiv-cs-cv

Cascade: Exploiting SLO-Aware latency budget for fair and high goodput LLM inference serving

arXiv:2608.06557v1 Announce Type: cross Abstract: The reasoning and agentic capabilities of large language models have expanded the range of applications they support, from short interactive exchanges

safetyarxiv-cs-lg

10 Aug 2026

Local Ai

EdgeXpert: An Edge Device for Memory-Efficient LLM Inference with Mixture-of-Experts and Speculative Decoding

arXiv:2608.05303v1 Announce Type: cross Abstract: On-device deployment of Large Language Models (LLMs) has become essential for personalized edge applications. A primary bottleneck is external memory

local-aiarxiv-cs-cl

7 Aug 2026

LLM Inference Under Bursty Workload Distribution: Modifying the WAIT Algorithm

arXiv:2608.06135v1 Announce Type: new Abstract: Large Language Models (LLMs) such as ChatGPT and Claude are widely used for information retrieval and problem-solving. Recent work has focused on improv

7 Aug 2026

Signal or Spurious Cue? A Randomized Audit of Survey-Country Metadata in LLM Social Inference

arXiv:2608.06085v1 Announce Type: new Abstract: Survey-country metadata can improve an LLM's forecast of an individual response when informative, yet the same cue may redirect the forecast when assign

7 Aug 2026

ATFlash: Per-RoPE-Wavelength Attention Windows for Compute/Memory-Efficient LLM Inference

model-releasesarxiv-cs-cl

arXiv:2608.02947v1 Announce Type: cross Abstract: The attention score with rotary position embeddings (RoPE) decomposes exactly into a sum over its 2D-rotation frequency pairs, and each pair's wavelen

BODHI: Do LLMs Branch Out and Discover Heterogeneous Inferences?

arXiv:2608.02867v1 Announce Type: cross Abstract: Although reinforcement learning with verifiable rewards (RLVR) has improved the performance of large language models (LLMs) across a variety of reason

safetyarxiv-cs-ai

Don't Let Me Ask for It: LLMs Show Deficiencies in Active Multi-Turn Information Acquisition for Abductive Inference

arXiv:2608.03388v1 Announce Type: new Abstract: Abductive reasoning requires forming hypotheses that explain observed evidence and revising them as new evidence becomes available. While large language

researcharxiv-cs-cl

Local Ai

GeoID-PINN: Identifiability-Aware Regional Epidemic Inference with Geographic Coupling

arXiv:2608.02633v1 Announce Type: new Abstract: Regional surveillance data reflect local transmission, reporting, seeding, and external infection pressure, which are difficult to identify separately.

local-aiarxiv-cs-lg

When Do Fewer Visual Tokens Accelerate Multimodal Inference? A Break-Even Study Across Decision Locations and Hardware

model-releasesarxiv-cs-cv

arXiv:2608.03649v1 Announce Type: new Abstract: Fewer visual tokens do not guarantee lower end-to-end latency. We evaluate break-even with a reproducible protocol that accounts for decision overhead,

Augmented Inverse Hybrid Weighting: Robust Inference under Deterministic and Random Distribution Shifts

arXiv:2608.00701v1 Announce Type: cross Abstract: Reweighting source samples to match a target covariate distribution is a standard response to distribution shift when generalizing evidence from one p

4 Aug 2026

Applications

PeCA: Palette Context Assisted Inference for Test-Time Paint-Bucket Colourisation on Animation Videos

arXiv:2608.00903v1 Announce Type: new Abstract: In animation production, paint-bucket colourisation for hand-drawn animation is a labour-intensive procedure that assigns each enclosed region in line s

applicationsarxiv-cs-cv

4 Aug 2026

Inference-time Trajectory Optimization for Structure-Preserving Manga Image Editing

model-releasesarxiv-cs-cv

arXiv:2603.27790v2 Announce Type: replace Abstract: We present a lightweight, training-free trajectory correction method that adapts a pretrained image editing model to each input manga image using on

3 Aug 2026

Applications

ViewMind3D: Modular View-Aware Inference for Training-Free 3D-QA

arXiv:2607.28442v1 Announce Type: new Abstract: Recent advances in large language models (LLMs) and vision-language models (VLMs) have enabled new possibilities for 3D question answering (3D-QA), a ke

applicationsarxiv-cs-cv

31 Jul 2026

The Confounder Trap: Treatment-Encoding Representations in Causal Inference with Text

arXiv:2607.26309v1 Announce Type: cross Abstract: Estimating causal effects of linguistic properties from observational text is difficult because the same document can contain both the treatment of in

safetyarxiv-cs-cl

30 Jul 2026

When benchmark inferences do not compose: Projectibility in AI evaluation

arXiv:2607.26159v1 Announce Type: cross Abstract: An AI benchmark result rarely reaches a consequential claim in one step. Evaluators generalize it to further cases, interpret it as evidence of capabi

30 Jul 2026

Applications

Enabling Fully Integer-Only Inference for Lightweight Detection Transformers

arXiv:2607.24981v1 Announce Type: new Abstract: Vision Transformer detectors now approach the accuracy of CNNs but remain difficult to deploy on NPUs and microcontrollers because key components, inclu

applicationsarxiv-cs-cv

29 Jul 2026

GLIDE: Guided Layerwise Hybrid Attention for Efficient LLM Inference

arXiv:2607.24788v1 Announce Type: new Abstract: As Large Language Models scale to increasingly long contexts, the memory I/O and computational overhead of the Key-Value (KV) cache during decoding emer

29 Jul 2026

Local Ai

DRC-Aid: Design-Rule Correction via Agentic Framework utilizing Inference-Time Large Language Models

arXiv:2607.22761v1 Announce Type: cross Abstract: Resolving Design Rule Violations (DRVs) in layouts entails an iterative loop of geometric edits and verification. We present DRC-Aid, a closed-loop ag

local-aiarxiv-cs-lg

28 Jul 2026

Semantic Field Theory: Historical Origin, Higher-Order Interaction, and Stabilized Semantic Inference

arXiv:2607.20451v1 Announce Type: new Abstract: Semantic Field Theory (SFT) has developed from a philosophical critique of strong anti-formalist readings of language games into a proposed computationa

researcharxiv-cs-cl

24 Jul 2026

Statistical Inference for Generative Model Comparison

arXiv:2501.18897v4 Announce Type: replace-cross Abstract: Generative models have achieved remarkable success across a range of applications, yet their evaluation still lacks principled uncertainty qua

24 Jul 2026

Kernel Ridge Regression Inference

arXiv:2302.06578v4 Announce Type: replace-cross Abstract: We provide uniform confidence bands for kernel ridge regression (KRR), a widely used nonparametric regression estimator for nonstandard data s

23 Jul 2026

LaCache: Exact Caching and Precision-Adaptive Inference for Diffusion Large Language Models

arXiv:2607.16339v2 Announce Type: replace Abstract: Diffusion-based Large Language Models(DLLMs) enable parallel generation via Semi-Autoregressive (SAR) decoding in text generation. However, current

23 Jul 2026

PRISM-DR: Per-lesion Retinal Inference with Specialist Models for Diabetic Retinopathy

arXiv:2607.19864v1 Announce Type: cross Abstract: Diabetic retinopathy is a leading cause of preventable blindness; its early lesions are small, low contrast, and easily missed in manual screening. Mo

23 Jul 2026

Inference Economics of Enterprise Coding Agents: A Case Study of Cloud vs. On-Premise LLMs

model-releasesarxiv-cs-ai

arXiv:2607.13080v1 Announce Type: cross Abstract: Autonomous coding agents force engineering organizations to choose between API-based frontier models -- strong reasoning at high token cost -- and on-

16 Jul 2026

PUe: Biased Positive-Unlabeled Learning Enhancement by Causal Inference

arXiv:2607.13428v1 Announce Type: new Abstract: Positive-Unlabeled (PU) learning aims to achieve high-accuracy binary classification with limited labeled positive examples and numerous unlabeled ones.

safetyarxiv-cs-lg

16 Jul 2026

Physically Consistent Parameter Inference: Transparent Machine Learning Emulation in High Energy Physics and Cosmology

arXiv:2607.12726v1 Announce Type: cross Abstract: Global fits in high energy physics and cosmology often face the challenge of exploring high-dimensional parameter spaces with computationally expensiv

15 Jul 2026

Tutorials

Partial Causal Structure Learning for Valid Selective Conformal Inference under Interventions

arXiv:2603.02204v2 Announce Type: replace Abstract: Selective conformal prediction can yield substantially tighter uncertainty sets when we can identify calibration examples that are exchangeable with

tutorialsarxiv-cs-lg

10 Jul 2026

Akashic: A Low-Overhead LLM Inference Service with MemAttention

arXiv:2607.05708v1 Announce Type: new Abstract: Recent LLM-based agent systems continuously accumulate context across multi-turn interactions, tool invocations, and cross-session workflows. Replaying

agentsarxiv-cs-ai

8 Jul 2026

Biologically Informed Deep Neural Networks for Multi-Omic Integration, Pathway Activity Inference and Risk Stratification in Cancer

arXiv:2607.05306v1 Announce Type: new Abstract: Integrating complex, multi-omics data presents significant challenges. Existing approaches often face a trade-off between model interpretability and rep

7 Jul 2026

Hardware

SPORK: Self-Speculative Forking to Accelerate Agentic LLM Inference

arXiv:2607.03333v1 Announce Type: cross Abstract: LLM agents are becoming a common interface for research, coding, and question answering, yet their Thought-Action-Observation loop is often serial: th

hardwarearxiv-cs-ai

7 Jul 2026

Tile-Level Activation Overlap for Efficient LLM Inference

arXiv:2607.02521v1 Announce Type: cross Abstract: SwiGLU is the dominant MLP activation in modern large language models, yet its intermediate tensor materialization costs 9-37% of MLP execution time.

7 Jul 2026

MMIR-TCM: Memory-Integrated Multimodal Inference and Retrieval for TCM Clinical Decision Support

model-releasesarxiv-cs-ai

arXiv:2607.01814v1 Announce Type: new Abstract: Traditional Chinese Medicine (TCM) diagnosis, particularly through tongue inspection, faces persistent challenges in subjectivity and reproducibility. T

3 Jul 2026

Proxy-GS: Unified Occlusion Priors for Training and Inference in Structured 3D Gaussian Splatting