Search: “inference”

Text-Vision Synergistic Token Caching: A Training-Free Framework for Efficient Vision-Language-Action Inference

arXiv:2609.34319v1 Announce Type: new Abstract: Vision-Language-Action (VLA) models enable generalizable robotic control but remain computationally expensive. Token caching provides a training-free, p

safetyarxiv-cs-cv

29 Sept 2026

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Research

Bayesian Uncertainty Quantification for fMRI Functional Connectivity via Simulation-Based Inference

DGX agent

arXiv:2609.30445v1 Announce Type: cross Abstract: Optimizing fMRI scan duration and spatial resolution is critical for experimental design, yet traditional correlation-based approaches cannot quantify

researcharxiv-cs-lg

28 Sept 2026

Albireo: Adaptive, Energy-Efficient Inference Framework for Video Object Detection on the Edge

arXiv:2609.29648v1 Announce Type: new Abstract: Video object detection on edge devices runs computationally expensive detectors over long frame streams, causing high energy consumption and sustained G

hardwarearxiv-cs-cv

25 Sept 2026

GeoDose-CP: Graph-Local Conformal Inference for Continuous-Treatment Earth Observation

arXiv:2609.28895v1 Announce Type: cross Abstract: Reliable intervention-oriented uncertainty quantification from Earth observation (EO) remains challenging when continuous treatment shifts, spatial de

local-aiarxiv-cs-lg

25 Sept 2026

PolyUMI: Accessible Visual-Tactile-Audio Data Collection for Object Inference and Manipulation

arXiv:2609.29760v1 Announce Type: new Abstract: Humans typically rely on vision, touch, hearing, and proprioception to perceive contact and adapt their actions during manipulation. Providing robots wi

safetyarxiv-cs-ro

25 Sept 2026

Recidivism Prediction, Peer Effect Estimation, and Prediction-Powered Inference with LLM Text Measures

arXiv:2509.20634v3 Announce Type: replace-cross Abstract: We provide a new framework for estimating peer effects when outcomes are multivariate behavioral measures derived from written text using an L

23 Sept 2026

Exactness at Inference: A Representational Criterion for Out-of-Distribution Generalization

arXiv:2609.24942v1 Announce Type: new Abstract: A model generalizes outside its training distribution only when it computes a representation structurally equivalent to the generating mechanism, not an

22 Sept 2026

Applications

Quantifying Hidden Salt for Precision Healthcare: Sodium Assessment via Joint-Factor Retrieval and Chain-of-Thought Inference

arXiv:2609.22171v1 Announce Type: new Abstract: Precision healthcare, particularly for conditions like hypertension and cardiovascular disease, necessitates monitoring of dietary sodium intake. Howeve

applicationsarxiv-cs-cl

22 Sept 2026

SCALE: Simulation-Calibrated Amortized Learning for Energy Materials (A hybrid architecture connecting deterministic modeling, real-world data, and transformer-scale inference for accelerated energy-materials discovery)

arXiv:2609.22233v1 Announce Type: new Abstract: Energy systems face converging pressures for security, affordability, resilience, and sustainability, creating a need for faster discovery of deployable

local-aiarxiv-cs-lg

22 Sept 2026

Zarya: A Hybrid Autoregressive--Masked Diffusion Language Model with Flexible Training and Dual-Mode Inference

arXiv:2609.19868v1 Announce Type: cross Abstract: Autoregressive language models (ARMs) are constrained by sequential, left-to-right generation, while masked diffusion models (MDMs) enable parallel de

18 Sept 2026

Agents

The Free Inference Dimension: Complexity Measure for Zero-Collision Navigation under Hypothesis Mixtures

arXiv:2609.17816v1 Announce Type: cross Abstract: Solomonoff induction frames prediction as a mixture over computable hypotheses, typically leading to identification of the true environment. In a fini

agentsarxiv-cs-ai

17 Sept 2026

Autoformalizing Argumentative Material Inferences

arXiv:2609.16991v1 Announce Type: new Abstract: Natural language arguments are compelling before they are formally explicit. A premise supports a claim through defeasible warrants, background commitme

researcharxiv-cs-cl

16 Sept 2026

AdaVSkip: Adaptive Visual Token Skipping Across Layers For Efficient MLLMs Inference

arXiv:2609.15131v1 Announce Type: cross Abstract: Multimodal large language models (MLLMs) require substantial computation to process numerous visual tokens across all transformer layers. Most methods

safetyarxiv-cs-ai

Bridging Control, Inference, Transport, and Thermodynamics: From Theory to Applications in Learning

arXiv:2609.15897v1 Announce Type: cross Abstract: The last decade has seen the development of powerful methods for learning complex structure from high-dimensional data. These advances have brought to

Calibrating subgrid parametrizations of single-column ocean models via simulation-based inference

model-releasesarxiv-cs-lg

arXiv:2609.13242v1 Announce Type: cross Abstract: Subgrid parametrizations of vertical mixing in ocean models depend on free coefficients that cannot be measured directly and must be calibrated agains

Identifying and Transferring Reasoning-Critical Neurons: Improving LLM Inference Reliability via Activation Steering

arXiv:2601.19847v3 Announce Type: replace Abstract: Despite the strong reasoning capabilities of recent large language models (LLMs), achieving reliable performance on challenging tasks often requires

researcharxiv-cs-cl

Mask, Sample, Revise: A Revisable CTMC Inference Stack for Guided Discrete Flow Matching Text-to-Speech

arXiv:2606.13989v2 Announce Type: replace-cross Abstract: Recent alignment-free non-autoregressive (NAR) text-to-speech (TTS) models formulate synthesis as a conditional infilling task, bypassing expl

safetyarxiv-cs-ai

Nonparametric Variance-Penalized Actor-Critic: Statistical Inference for Risk-Sensitive Reinforcement Learning

arXiv:2609.14327v1 Announce Type: new Abstract: Variance penalization is a principled approach to risk-sensitive reinforcement learning (RL) that explicitly trades expected return for policy stability

Dynamic Expert Quantization for Scalable Mixture-of-Experts Inference

arXiv:2511.15015v4 Announce Type: replace-cross Abstract: Mixture-of-Experts (MoE) has become a practical architecture for scaling LLM capacity while keeping per-token compute modest, but deploying Mo

hardwarearxiv-cs-lg

14 Sept 2026

When and Why LLM Causal Priors Help: Closed-Loop Prior Selection for Amortized Causal Inference

model-releasesarxiv-cs-ai

arXiv:2609.06941v1 Announce Type: new Abstract: Causal effect estimation asks how an outcome would change under an intervention, and medicine, economics, and public policy all treat it as a foundation

10 Sept 2026

CALIPER: Clean Scenes Cannot Rank Physical Inference in Pretrained Visual Representations

model-releasesarxiv-cs-cv

arXiv:2609.08250v1 Announce Type: cross Abstract: How far a pushed object slides depends on its mass and friction, which no single image reveals. Pretrained visual encoders are increasingly used as th

9 Sept 2026

Streaming Hierarchical Inference with Tabular Foundation Models

arXiv:2609.07956v1 Announce Type: new Abstract: Tabular Foundation Models (TFMs) have recently demonstrated strong predictive performance through in-context learning, but their deployment in high-thro

9 Sept 2026

Temporal-Causal Inference for Reinforcement Learning via Automata Learning

arXiv:2609.07461v1 Announce Type: new Abstract: We consider reinforcement learning in environments with dynamics that undergo an irreversible phase transition governed by a hidden temporal pattern. Th

9 Sept 2026

Reasoning Without Inference Cost: Latent Semantic Scaffolding for Robot VLA Policies

arXiv:2609.04893v1 Announce Type: new Abstract: Vision-language-action (VLA) models are trained by imitation and capture what action to take but not why; adding causal reasoning improves manipulation,

safetyarxiv-cs-ro

7 Sept 2026

TPU Inference Externalization Full Steam Ahead - InferenceX

Google has begun allowing third‑party customers to acquire or rent its TPU chips—starting with the TPUv7 “Ironwood” generation. In comparative tests against NVIDIA Volta (B200/B300), Ironwood shows up

hardwaresemianalysis

7 Sept 2026

Applications

Equinix turns the network into the control plane for enterprise AI inference

At its first Horizon customer and partner event this week, Equinix Inc. argued that the architecture of enterprise artificial intelligence is being reshaped by a simple yet hard-to-answer question: Wh

applicationssiliconangle

5 Sept 2026

Active learning for data-driven reduced models of parametric differential systems with Bayesian operator inference

model-releasesarxiv-cs-lg

arXiv:2601.00038v2 Announce Type: replace-cross Abstract: This work develops an active learning framework to intelligently enrich data-driven reduced-order models (ROMs) of parametric dynamical system

4 Sept 2026

Stabilizing Camera-Controlled Novel View Synthesis at Inference Time

arXiv:2609.03639v1 Announce Type: new Abstract: Training-free, camera-controlled novel view synthesis from a single image using pre-trained video diffusion models often becomes unstable under large ca

researcharxiv-cs-cv

4 Sept 2026

Subspace Inference Enables Efficient Active Reward Learning from Preferences

model-releasesarxiv-cs-ai

arXiv:2609.04066v1 Announce Type: cross Abstract: Reinforcement learning from human feedback (RLHF) has emerged as a powerful yet sample-inefficient approach for learning reward models from human pref

4 Sept 2026

HEAT: Faster Fully Homomorphic Inference via Approximations-Weights Co-Adaptation

arXiv:2609.01730v1 Announce Type: cross Abstract: Fully homomorphic encryption (FHE) allows a server to run a language model directly on encrypted user prompts, but current approaches remain prohibiti

3 Sept 2026

MeanField Surrogate Modeling for Scalable Runtime Scheduling of Concurrent Heterogeneous AI Inference on Shared GPUs

arXiv:2609.02109v1 Announce Type: cross Abstract: Deploying heterogeneous AI models concurrently on a shared GPU introduces resource contention that complicates runtime scheduling. While surrogate mod

local-aiarxiv-cs-ai

3 Sept 2026

MultiGait: A Multi-Sensor Multi-Perspective Multi-Session Biometric Inference Benchmark and its Dataset

model-releasesarxiv-cs-cv

arXiv:2609.01036v1 Announce Type: cross Abstract: A lack of suitable datasets has limited the research into the privacy risks of novel smart city sensors, such as thermal cameras, depth cameras, and l

2 Sept 2026

Tutorials

Recent Developments in Transformer Inference Deployment on FPGA Platforms: A Survey

arXiv:2609.01212v1 Announce Type: new Abstract: With the rapid and continuous growth in the incorporation of machine learning models based on the Transformer architecture, capable deployment is in hig

tutorialsarxiv-cs-lg

2 Sept 2026

Budget-Aware Compression Pipeline for Single-GPU LLM Inference: Methods, Trade-offs, and Coupling Effects

model-releasesarxiv-cs-cl

arXiv:2608.30076v1 Announce Type: new Abstract: Single-GPU deployment of 70B-parameter language models on an NVIDIA GPU is constrained by device memory, long-context throughput, and engineering integr

1 Sept 2026

Amortizing intractable inference in diffusion models for vision, language, and control

arXiv:2405.20971v3 Announce Type: replace-cross Abstract: Diffusion models have emerged as effective distribution estimators in vision, language, and reinforcement learning, but their use as priors in

researcharxiv-cs-cv

31 Aug 2026

FAMPWQ: Fisher Information-based Adaptive Mixed Precision Weight Quantization for Effective LLM Inference

arXiv:2608.24945v1 Announce Type: new Abstract: Recent years have witnessed remarkable achievements of Large Language Models (LLMs) in multiple domains, while the excessive resource requirements of LL

GGSS: Geodesic-Gated Spherical Steering for Inference-Time Debiasing of Generative Vision-Language Models

arXiv:2608.25375v1 Announce Type: cross Abstract: Generative vision-language models (VLMs) are increasingly used in human-centered settings, yet they can produce demographically biased outputs even wh

safetyarxiv-cs-cl

Tutorials

Natural Language Input, Semantic Track Representation, and LLM Inference: Making the Maritime Information Exchange Model Tractable

arXiv:2608.24892v1 Announce Type: cross Abstract: We describe a practical architecture for making the Maritime Information Exchange Model (MIEM) and the broader Rich Semantic Track model tractable usi

tutorialsarxiv-cs-cl

Scorpio: Serving Right Requests at the Right Time for Heterogeneous SLOs in LLM Inference

arXiv:2505.23022v2 Announce Type: replace Abstract: Large Language Model (LLM) serving increasingly underpins online Web services such as conversational agents, Web search, and programming assistants,

Thermodynamic cost of inference and learning in physical neural networks

arXiv:2503.09980v4 Announce Type: replace-cross Abstract: How much of the energy consumed by artificial neural networks is set by physics rather than by implementation? For irreversible digital hardwa

SAGE: From Direct Answering to Evidence-Grounded Inference for Chinese Ancient Document Understanding

model-releasesarxiv-cs-ai

arXiv:2608.24011v1 Announce Type: cross Abstract: Chinese ancient document understanding demands complex visual, linguistic, and historical reasoning. Current Large Vision-Language Models (LVLMs) typi

26 Aug 2026

ChebBooster: A Training-Free Approach for Efficient Diffusion Transformer Inference via Chebyshev-Inspired Extrapolation

arXiv:2608.23429v1 Announce Type: cross Abstract: Diffusion Transformers (DiTs) have shown strong performance in high-fidelity image generation, but their sampling process remains computationally inte

Tutorials

Joint Causal Structure and Cluster Discovery Using Variational Inference

arXiv:2608.22212v1 Announce Type: cross Abstract: Causal discovery aims to understand the relationships between individual random variables. In many applications, such as brain imaging and climate mod

tutorialsarxiv-cs-ai

Restore LLM Inference Capacity in Seconds with Shadow Engine Recovery in NVIDIA Dynamo

Shadow Engine Recovery in NVIDIA Dynamo keeps a fully-initialized standby LLM engine on the same GPU, using the GPU Memory Service (GMS) to persist model weights and share them across engines without

hardwarenvidia-developer

SAEM: Stage-Aware Expert Management for Memory-Efficient MoE Inference in Chain-of-Thought Reasoning

arXiv:2608.21614v1 Announce Type: new Abstract: Chain-of-thought (CoT) prompting improves LLM reasoning by decomposing complex problems into intermediate steps, but its sequential nature increases dec

local-aiarxiv-cs-ai

The Measurement Revolution? Credible Measurement and Inference in the Age of AI

arXiv:2608.23524v1 Announce Type: cross Abstract: Artificial intelligence (AI) is transforming measurement in economics. AI models convert unstructured data, such as text and images, into structured v

DAOP: Data-Aware Offloading and Predictive Pre-Calculation for Efficient MoE Inference

arXiv:2501.10375v3 Announce Type: replace-cross Abstract: Mixture-of-Experts (MoE) models, though highly effective for various machine learning tasks, face significant deployment challenges on memory-

local-aiarxiv-cs-lg

24 Aug 2026

Trying to optimize LLM inference latency — Ollama + OpenWebUI/AnythingLLM