Search: “inference”

AdaVSkip: Adaptive Visual Token Skipping Across Layers For Efficient MLLMs Inference

arXiv:2609.15131v1 Announce Type: cross Abstract: Multimodal large language models (MLLMs) require substantial computation to process numerous visual tokens across all transformer layers. Most methods

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Research

Bridging Control, Inference, Transport, and Thermodynamics: From Theory to Applications in Learning

DGX agent

arXiv:2609.15897v1 Announce Type: cross Abstract: The last decade has seen the development of powerful methods for learning complex structure from high-dimensional data. These advances have brought to

researcharxiv-cs-lg

15 Sept 2026

Calibrating subgrid parametrizations of single-column ocean models via simulation-based inference

model-releasesarxiv-cs-lg

arXiv:2609.13242v1 Announce Type: cross Abstract: Subgrid parametrizations of vertical mixing in ocean models depend on free coefficients that cannot be measured directly and must be calibrated agains

Identifying and Transferring Reasoning-Critical Neurons: Improving LLM Inference Reliability via Activation Steering

arXiv:2601.19847v3 Announce Type: replace Abstract: Despite the strong reasoning capabilities of recent large language models (LLMs), achieving reliable performance on challenging tasks often requires

researcharxiv-cs-cl

Mask, Sample, Revise: A Revisable CTMC Inference Stack for Guided Discrete Flow Matching Text-to-Speech

arXiv:2606.13989v2 Announce Type: replace-cross Abstract: Recent alignment-free non-autoregressive (NAR) text-to-speech (TTS) models formulate synthesis as a conditional infilling task, bypassing expl

Nonparametric Variance-Penalized Actor-Critic: Statistical Inference for Risk-Sensitive Reinforcement Learning

arXiv:2609.14327v1 Announce Type: new Abstract: Variance penalization is a principled approach to risk-sensitive reinforcement learning (RL) that explicitly trades expected return for policy stability

Dynamic Expert Quantization for Scalable Mixture-of-Experts Inference

arXiv:2511.15015v4 Announce Type: replace-cross Abstract: Mixture-of-Experts (MoE) has become a practical architecture for scaling LLM capacity while keeping per-token compute modest, but deploying Mo

hardwarearxiv-cs-lg

14 Sept 2026

When and Why LLM Causal Priors Help: Closed-Loop Prior Selection for Amortized Causal Inference

arXiv:2609.06941v1 Announce Type: new Abstract: Causal effect estimation asks how an outcome would change under an intervention, and medicine, economics, and public policy all treat it as a foundation

10 Sept 2026

CALIPER: Clean Scenes Cannot Rank Physical Inference in Pretrained Visual Representations

model-releasesarxiv-cs-cv

arXiv:2609.08250v1 Announce Type: cross Abstract: How far a pushed object slides depends on its mass and friction, which no single image reveals. Pretrained visual encoders are increasingly used as th

9 Sept 2026

Streaming Hierarchical Inference with Tabular Foundation Models

arXiv:2609.07956v1 Announce Type: new Abstract: Tabular Foundation Models (TFMs) have recently demonstrated strong predictive performance through in-context learning, but their deployment in high-thro

9 Sept 2026

Temporal-Causal Inference for Reinforcement Learning via Automata Learning

arXiv:2609.07461v1 Announce Type: new Abstract: We consider reinforcement learning in environments with dynamics that undergo an irreversible phase transition governed by a hidden temporal pattern. Th

9 Sept 2026

Reasoning Without Inference Cost: Latent Semantic Scaffolding for Robot VLA Policies

arXiv:2609.04893v1 Announce Type: new Abstract: Vision-language-action (VLA) models are trained by imitation and capture what action to take but not why; adding causal reasoning improves manipulation,

safetyarxiv-cs-ro

7 Sept 2026

Active learning for data-driven reduced models of parametric differential systems with Bayesian operator inference

model-releasesarxiv-cs-lg

arXiv:2601.00038v2 Announce Type: replace-cross Abstract: This work develops an active learning framework to intelligently enrich data-driven reduced-order models (ROMs) of parametric dynamical system

4 Sept 2026

Stabilizing Camera-Controlled Novel View Synthesis at Inference Time

arXiv:2609.03639v1 Announce Type: new Abstract: Training-free, camera-controlled novel view synthesis from a single image using pre-trained video diffusion models often becomes unstable under large ca

researcharxiv-cs-cv

4 Sept 2026

Subspace Inference Enables Efficient Active Reward Learning from Preferences

arXiv:2609.04066v1 Announce Type: cross Abstract: Reinforcement learning from human feedback (RLHF) has emerged as a powerful yet sample-inefficient approach for learning reward models from human pref

4 Sept 2026

HEAT: Faster Fully Homomorphic Inference via Approximations-Weights Co-Adaptation

arXiv:2609.01730v1 Announce Type: cross Abstract: Fully homomorphic encryption (FHE) allows a server to run a language model directly on encrypted user prompts, but current approaches remain prohibiti

3 Sept 2026

MeanField Surrogate Modeling for Scalable Runtime Scheduling of Concurrent Heterogeneous AI Inference on Shared GPUs

arXiv:2609.02109v1 Announce Type: cross Abstract: Deploying heterogeneous AI models concurrently on a shared GPU introduces resource contention that complicates runtime scheduling. While surrogate mod

local-aiarxiv-cs-ai

3 Sept 2026

MultiGait: A Multi-Sensor Multi-Perspective Multi-Session Biometric Inference Benchmark and its Dataset

model-releasesarxiv-cs-cv

arXiv:2609.01036v1 Announce Type: cross Abstract: A lack of suitable datasets has limited the research into the privacy risks of novel smart city sensors, such as thermal cameras, depth cameras, and l

2 Sept 2026

Tutorials

Recent Developments in Transformer Inference Deployment on FPGA Platforms: A Survey

arXiv:2609.01212v1 Announce Type: new Abstract: With the rapid and continuous growth in the incorporation of machine learning models based on the Transformer architecture, capable deployment is in hig

tutorialsarxiv-cs-lg

2 Sept 2026

Budget-Aware Compression Pipeline for Single-GPU LLM Inference: Methods, Trade-offs, and Coupling Effects

model-releasesarxiv-cs-cl

arXiv:2608.30076v1 Announce Type: new Abstract: Single-GPU deployment of 70B-parameter language models on an NVIDIA GPU is constrained by device memory, long-context throughput, and engineering integr

1 Sept 2026

Amortizing intractable inference in diffusion models for vision, language, and control

arXiv:2405.20971v3 Announce Type: replace-cross Abstract: Diffusion models have emerged as effective distribution estimators in vision, language, and reinforcement learning, but their use as priors in

researcharxiv-cs-cv

31 Aug 2026

FAMPWQ: Fisher Information-based Adaptive Mixed Precision Weight Quantization for Effective LLM Inference

arXiv:2608.24945v1 Announce Type: new Abstract: Recent years have witnessed remarkable achievements of Large Language Models (LLMs) in multiple domains, while the excessive resource requirements of LL

GGSS: Geodesic-Gated Spherical Steering for Inference-Time Debiasing of Generative Vision-Language Models

arXiv:2608.25375v1 Announce Type: cross Abstract: Generative vision-language models (VLMs) are increasingly used in human-centered settings, yet they can produce demographically biased outputs even wh

safetyarxiv-cs-cl

Tutorials

Natural Language Input, Semantic Track Representation, and LLM Inference: Making the Maritime Information Exchange Model Tractable

arXiv:2608.24892v1 Announce Type: cross Abstract: We describe a practical architecture for making the Maritime Information Exchange Model (MIEM) and the broader Rich Semantic Track model tractable usi

tutorialsarxiv-cs-cl

Scorpio: Serving Right Requests at the Right Time for Heterogeneous SLOs in LLM Inference

arXiv:2505.23022v2 Announce Type: replace Abstract: Large Language Model (LLM) serving increasingly underpins online Web services such as conversational agents, Web search, and programming assistants,

Thermodynamic cost of inference and learning in physical neural networks

arXiv:2503.09980v4 Announce Type: replace-cross Abstract: How much of the energy consumed by artificial neural networks is set by physics rather than by implementation? For irreversible digital hardwa

SAGE: From Direct Answering to Evidence-Grounded Inference for Chinese Ancient Document Understanding

arXiv:2608.24011v1 Announce Type: cross Abstract: Chinese ancient document understanding demands complex visual, linguistic, and historical reasoning. Current Large Vision-Language Models (LVLMs) typi

26 Aug 2026

ChebBooster: A Training-Free Approach for Efficient Diffusion Transformer Inference via Chebyshev-Inspired Extrapolation

arXiv:2608.23429v1 Announce Type: cross Abstract: Diffusion Transformers (DiTs) have shown strong performance in high-fidelity image generation, but their sampling process remains computationally inte

Tutorials

Joint Causal Structure and Cluster Discovery Using Variational Inference

arXiv:2608.22212v1 Announce Type: cross Abstract: Causal discovery aims to understand the relationships between individual random variables. In many applications, such as brain imaging and climate mod

tutorialsarxiv-cs-ai

SAEM: Stage-Aware Expert Management for Memory-Efficient MoE Inference in Chain-of-Thought Reasoning

arXiv:2608.21614v1 Announce Type: new Abstract: Chain-of-thought (CoT) prompting improves LLM reasoning by decomposing complex problems into intermediate steps, but its sequential nature increases dec

local-aiarxiv-cs-ai

The Measurement Revolution? Credible Measurement and Inference in the Age of AI

arXiv:2608.23524v1 Announce Type: cross Abstract: Artificial intelligence (AI) is transforming measurement in economics. AI models convert unstructured data, such as text and images, into structured v

DAOP: Data-Aware Offloading and Predictive Pre-Calculation for Efficient MoE Inference

arXiv:2501.10375v3 Announce Type: replace-cross Abstract: Mixture-of-Experts (MoE) models, though highly effective for various machine learning tasks, face significant deployment challenges on memory-

local-aiarxiv-cs-lg

24 Aug 2026

Causal Inference under Interference with Learned Exposure Mappings

arXiv:2608.19224v1 Announce Type: cross Abstract: Exposure mappings are often assumed to be known in causal spillover analyses. In environmental settings, however, they are typically induced by transp

local-aiarxiv-cs-ai

21 Aug 2026

Daedalus-150M: A Convolution-Attention Hybrid Designed for CPU Inference

arXiv:2608.20210v1 Announce Type: cross Abstract: Small language models are usually built like large ones and then squeezed onto a CPU afterwards. We did the opposite: we fixed the target first, one u

21 Aug 2026

Pre-Compiled Pipeline Shards for Distributed LLM Inference on Intel AI PC Fleets

arXiv:2608.19147v1 Announce Type: cross Abstract: Modern Intel AI PCs ship capable integrated GPUs and NPUs with 16+ GB of unified memory, and they spend considerable time idle. That is not enough mem

20 Aug 2026

ProxyGuard: Direct Reliability Inference for Randomized Data Release Mechanisms with Shared Targets

arXiv:2608.18643v1 Announce Type: new Abstract: Researchers often choose a proxy dataset from many releases, transformations, or seeds. Search can make an invalid release appear adequate, while one ad

20 Aug 2026

JUMP: Single-Pass Membership Inference on Fine-Tuned Diffusion Language Models

arXiv:2607.16207v2 Announce Type: replace Abstract: Public open-weight language models are often fine-tuned on private or domain-specific data before deployment, creating a need to audit whether indiv

19 Aug 2026

Contrastive Energy Fields for Inference-Time Procedure Planning in Instructional Videos

arXiv:2608.16457v1 Announce Type: cross Abstract: Procedure planning seeks to estimate a sequence of actions to transition from an observed initial state to a given goal state. Current procedure plann

Efficient Block-Layer Parallel Inference for Vision-Language-Action on Hybrid Architectures

arXiv:2608.14586v1 Announce Type: cross Abstract: Vision-Language-Action (VLA) models are becoming a promising paradigm for autonomous driving, but their deployment on existing vehicle platforms remai

hardwarearxiv-cs-ai

Every Expert Counts: ExactMoE for Memory-Efficient W4A16 Inference

arXiv:2608.15383v1 Announce Type: new Abstract: Sparse mixture-of-experts (MoE) language models reduce arithmetic by activating only a small subset of experts per token, yet deployment still requires

hardwarearxiv-cs-lg

Multi-Modal Generative Fuzzy System: Fuzzy Inference Guided Large Model Interactive Question Answering Framework

arXiv:2608.14584v1 Announce Type: cross Abstract: In Multimodal Question Answering (MQA), models are required to jointly encode and integrate heterogeneous information from multiple modalities, includ

AtomBridge: Agentic VLA Inference Plugin for Long-Horizon Tasks in Scientific Experiments

arXiv:2602.09430v2 Announce Type: replace-cross Abstract: Robotic laboratories play a critical role in autonomous scientific discovery by enabling scalable, continuous experimental execution. Recent v

17 Aug 2026

Automated Inference of Graph Transformation Rules

arXiv:2404.02692v3 Announce Type: replace-cross Abstract: The explosion of data available in life sciences is fueling an increasing demand for expressive models and computational methods. Graph transf

17 Aug 2026

hint^2: Hierarchical World Models for Inference-Time Temporal Logic Guidance

arXiv:2608.13678v1 Announce Type: cross Abstract: A central goal of robot learning is to enable robots to execute rich instructions specified at runtime. Large-scale language-conditioned policies have

local-aiarxiv-cs-lg

17 Aug 2026

Balanced Adaptive Prototype Selection for Scalable TabPFN Inference on Large-Scale Tabular Data

arXiv:2608.12989v1 Announce Type: new Abstract: Pretrained tabular foundation models have demonstrated strong predictive capability; however, their application to large-scale datasets remains constrai

hardwarearxiv-cs-lg

14 Aug 2026

Gradual Code-Switching as Inference-Time Cross-Lingual Representational Alignment for LLMs

arXiv:2510.05678v2 Announce Type: replace-cross Abstract: While large language models (LLMs) have achieved notable progress in multilingual settings, their performance remains uneven across languages

14 Aug 2026

Spatially-Grounded Text-to-Video Generation via Inference-Time Gradient-Free Optimization

arXiv:2608.13037v1 Announce Type: new Abstract: Diffusion Transformer Text-to-Video models have achieved remarkable synthesis quality, yet fine-grained spatial controllability remains a significant ch

researcharxiv-cs-cv

14 Aug 2026

APEX: Adaptive Expert Prefetching for Memory-Efficient Edge MoE Inference

arXiv:2608.11688v1 Announce Type: cross Abstract: Mixture-of-Experts (MoE) models are attractive for edge deployment because they provide high model capacity while activating only a small subset of pa