Search: “inference”

OnlineCache: Learning Dynamic Caching Policies with Error Correction for Efficient Diffusion Inference

arXiv:2607.29398v1 Announce Type: new Abstract: Diffusion models have revolutionized generative tasks but incur high latency due to iterative denoising. While cache-based strategies accelerate inferen

local-aiarxiv-cs-lg

3 Aug 2026

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Local Ai

FeatFix: Reuse What You Verify through Local Exact-Feature Correction for Faster Cached Diffusion Inference

DGX agent

arXiv:2607.27842v1 Announce Type: new Abstract: Diffusion models are widely used to generate high-quality images and videos, but their iterative denoising process remains computationally intensive. A

local-aiarxiv-cs-cv

31 Jul 2026

Inference-Time Agentic Decision Rules Beat Longer Evolving Search for Multi-Image Medical Reasoning

arXiv:2607.27564v1 Announce Type: new Abstract: Multi-image medical VQA is not merely a prompt-length problem; it is a fundamental challenge of agentic decision-making. Medical vision-language agents

31 Jul 2026

No Data Is Not No Risk: Visibility Aware Graph-Based Inference of Business Conduct Risk

arXiv:2607.26859v1 Announce Type: cross Abstract: The monitoring of business conduct risk is hindered by sparse, uneven, and visibility-biased data. Prior studies show that business conduct risk infor

30 Jul 2026

Safety-Aware Cascaded Inference for Crop Damage Assessment with Controlled Error Trade-offs

arXiv:2607.25468v1 Announce Type: new Abstract: In picture-based agricultural insurance for smallholder farmers, missed damage detections carry substantially higher cost than false alarms: a farmer wh

29 Jul 2026

Act, Think or Abstain: Complexity-Aware Adaptive Inference for Vision-Language-Action Models

arXiv:2603.05147v2 Announce Type: replace Abstract: Current research on Vision-Language-Action (VLA) models predominantly focuses on enhancing generalization through reasoning techniques. While effect

researcharxiv-cs-cv

Applications

LithoFormer: A Robust Framework for Stratigraphic Inference via Transformers

arXiv:2607.22804v1 Announce Type: cross Abstract: Accurate geological characterization of subsurface reservoirs from well log data is essential to support projects such as carbon capture and storage (

applicationsarxiv-cs-ai

Similarity Is Not Logic: Factored Inference for Dual-Encoder Vision-Language Models

arXiv:2607.23052v1 Announce Type: cross Abstract: Dual-encoder vision-language models (VLMs) expose a similarity interface that enables zero-shot retrieval but fails compositional constraints: queries

researcharxiv-cs-cl

Verbalized Particle Posterior: Bayesian Inference over Natural Language Hypotheses

model-releasesarxiv-cs-cl

arXiv:2607.22961v1 Announce Type: cross Abstract: Verbalized Machine Learning (VML) parameterizes a model as a natural-language prompt that an LLM evaluates as f(x; theta). The framework is interpreta

Evolving Cache Schedules for Fast Diffusion Policy Inference

arXiv:2607.20293v1 Announce Type: new Abstract: Diffusion policies achieve strong visuomotor control by iteratively denoising action chunks, but repeated denoising makes real-time deployment computati

How Fast Can Reward Models Score? A Systems Study of C++ and PyTorch Inference Runtimes for RLHF

arXiv:2607.19712v1 Announce Type: new Abstract: In RLHF pipelines, reward scoring blocks policy updates. Slow scoring bottlenecks the entire loop, since no update runs until every rollout gets a score

Membership Inference Attacks for Unseen Classes

arXiv:2506.06488v3 Announce Type: replace Abstract: A key tool in developing safe AI models is data auditing, i.e., using statistical tools to determine whether harmful content may have been used in t

Statistical Inference for Rank Allocation in Low-Rank Adaptation

arXiv:2607.20205v1 Announce Type: cross Abstract: Low-rank adaptation (LoRA) has become a widely used parameter-efficient fine-tuning method for large language models. Since different modules and laye

Optimizing Binary and Ternary Neural Network Inference on RRAM Crossbars using CIM-Explorer

arXiv:2505.14303v3 Announce Type: replace-cross Abstract: Using Resistive Random Access Memory (RRAM) crossbars in Computing-in-Memory (CIM) architectures offers a promising solution to overcome the v

16 Jul 2026

The SIGReg Objective as Variational Free Energy: A Theoretical Active-Inference Account of JEPA World Models

arXiv:2607.13612v1 Announce Type: cross Abstract: Joint-Embedding Predictive Architectures (JEPAs) are the dominant design for latent world models, yet they are usually justified by empirical performa

safetyarxiv-cs-ai

16 Jul 2026

Hardware

Globalized Constrained Stein Variational Inference for Diverse Feasible Robot Motion Planning

arXiv:2607.12732v1 Announce Type: new Abstract: Robot motion planning is inherently multimodal, yet classical planners typically return only a single solution. Probabilistic formulations address this

hardwarearxiv-cs-ro

15 Jul 2026

PhyMAGIC: Physical Motion-Aware Generative Inference with Confidence-guided LLM

arXiv:2505.16456v3 Announce Type: replace Abstract: Recent advances in 3D content generation have amplified demand for dynamic models that are both visually realistic and physically consistent. Howeve

10 Jul 2026

Statistical Efficiency and Inference of Quantile Distributional Reinforcement Learning

arXiv:2607.08444v1 Announce Type: cross Abstract: In this paper, we study quantile-based distributional reinforcement learning from the perspective of statistical efficiency. We focus on distributiona

10 Jul 2026

Workload-Preserving Differentially Private Synthetic Data for Causal Inference via Maximum-Entropy Calibration

arXiv:2607.08122v1 Announce Type: new Abstract: Workload-based differentially private (DP) synthetic data methods privately measure aggregate queries and post-process the noisy answers into synthetic

10 Jul 2026

Amortized Inference for Correlated Discrete Choice Models via Equivariant Neural Networks

arXiv:2603.24705v3 Announce Type: replace-cross Abstract: Discrete choice models are fundamental tools in management science, economics, and marketing for understanding and predicting decision-making.

Hardware

InferNet: Exploiting Aggregate GPU Profiles as Side-Channel for DNN Architecture Inference

arXiv:2304.03388v2 Announce Type: replace Abstract: Deep Neural Networks (DNNs) have become ubiquitous for their ability to solve problems across various domains, including computer vision, natural la

hardwarearxiv-cs-lg

Refine Thought: A Test-Time Inference Method for Embedding Model Reasoning

arXiv:2511.13726v2 Announce Type: replace-cross Abstract: We propose RT (Refine Thought), a method that can enhance the semantic reasoning ability of text embedding models. The method obtains the fina

Trajectory Inference of Human Aging from Cross-Sectional DNA Methylation Data

arXiv:2607.06583v1 Announce Type: cross Abstract: DNA methylation (DNAm) serves as one of the most robust molecular biomarkers of biological aging. While conventional epigenetic clocks accurately pred

FIELDS: Face reconstruction with accurate Inference of Expression using Learning with Direct Supervision

arXiv:2511.21245v3 Announce Type: replace Abstract: Monocular 3D face reconstruction estimates a 3D morphable model (3DMM) representation from a single image, providing geometry-aware expression codes

researcharxiv-cs-cv

8 Jul 2026

Quantize the Target, Quantize the Drafter: Efficient Inference with Qwen3.5-4B

arXiv:2607.04244v1 Announce Type: new Abstract: This report describes our approach to the Efficient Qwen Competition, where the goal is to enable low-latency serving of Qwen3.5-4B on a resource-constr

7 Jul 2026

Recursive Entropic Variational Inference for Nonlinear State-Space Models

arXiv:2511.15409v2 Announce Type: replace Abstract: We present a class of algorithms for state estimation in nonlinear, non-Gaussian state-space models. Our approach is based on a variational Lagrangi

7 Jul 2026

Black-Box Inference of LLM Architectural Properties with Restrictive API Access

arXiv:2607.01313v1 Announce Type: cross Abstract: In practice, most commercial LLM providers do not publicly release details of underlying LLM architectures. However, prior work has shown that given l

Embedding Inference Attack

arXiv:2607.01276v1 Announce Type: cross Abstract: Embedding models are essential components of modern Information Retrieval (IR) systems, yet they are typically hidden behind APIs. Recent works have s

ProCal: Inference-Time Proposal Calibration for Open-Vocabulary Object Detection

arXiv:2607.01759v1 Announce Type: cross Abstract: Open-vocabulary object detection aims to localize and classify objects beyond the fixed set of categories seen dur ing training. Recent open-vocabular

local-aiarxiv-cs-ai

Separating Expert Retention from Autonomous Source Inference in Raw-ECG-Replay-Free Continual ECG Deployment

arXiv:2607.01674v1 Announce Type: new Abstract: In multi-source ECG deployment, models may need to incorporate new data sources when earlier raw ECGs cannot be retained or replayed. Freezing a pretrai

VaSST: Variational Inference for Symbolic Regression using Soft Symbolic Trees

arXiv:2602.23561v2 Announce Type: replace-cross Abstract: Symbolic regression (SR) has gained recent traction in AI-driven scientific discovery for learning closed-form physical laws. Yet existing met

VLA-Corrector: Lightweight Detect-and-Correct Inference for Adaptive Action Horizon

arXiv:2607.01804v1 Announce Type: new Abstract: Vision-Language-Action (VLA) foundation models have recently achieved strong progress in embodied intelligence. To reduce policy-call frequency while pr

local-aiarxiv-cs-ro

Personalized Object Identification and Localization via In-Context Inference with Vision-Language Models

arXiv:2607.00357v1 Announce Type: new Abstract: Personalized object localization (POL) localizes an object instance in a query image based on a few reference images with bounding-box annotations and a

local-aiarxiv-cs-cv

2 Jul 2026

Coverage-Driven KV Cache Eviction for Efficient and Improved Inference of LLM

arXiv:2606.29563v1 Announce Type: cross Abstract: Large language models (LLMs) excel at complex tasks like question answering and summarization, thanks to their ability to handle long-context inputs.

Federated Learning with Energy-Based Structured Probabilistic Inference

arXiv:2606.30161v1 Announce Type: cross Abstract: Federated learning typically aggregates client updates using fixed or heuristic weighting rules, which can be suboptimal when clients have heterogeneo

Guided Unconditional and Conditional Generative Models for Super-Resolution and Inference of Quasi-Geostrophic Turbulence

arXiv:2507.00719v3 Announce Type: replace-cross Abstract: Typically, numerical simulations of Earth systems are coarse, and Earth observations are sparse and gappy. We apply four generative diffusion

I-BBS: Coordinate-Free Inference of Latent Sub-Manifolds Using Random Distance Matrix Theory

arXiv:2606.29675v1 Announce Type: new Abstract: Bogomolny, Bohigas and Schmit (BBS) found that the spectrum of the pairwise distance matrix on N points sampled from a smooth d-dimensional manifold enc

Tutorials

ScaleErasure: Inference-Time Minimal Intervention for Precise Concept Erasure in Next-Scale Autoregressive Image Generation

arXiv:2606.29282v1 Announce Type: new Abstract: Concept erasure aims to prevent image generative models from producing unsafe content while preserving their general generative capability. Meanwhile, n

tutorialsarxiv-cs-cv

StackingNet: Collective Inference Across Independent AI Foundation Models

arXiv:2602.13792v2 Announce Type: replace Abstract: Artificial intelligence built on large foundation models has transformed language understanding, computer vision, and reasoning, yet these systems r

safetyarxiv-cs-ai

Applications

KISS-IMU: Self-supervised Inertial Odometry with Motion-balanced Learning and Uncertainty-aware Inference

arXiv:2603.06205v2 Announce Type: replace Abstract: Inertial measurement units (IMUs), which provide high-frequency linear acceleration and angular velocity measurements, serve as fundamental sensing

applicationsarxiv-cs-ro

Ontology-Guided Evidence Path Inference for Multi-hop Knowledge Graph Question Answering

arXiv:2606.28076v1 Announce Type: new Abstract: Knowledge graph question answering (KGQA) aims to answer natural-language questions by reasoning over structured facts. Existing multi-hop KGQA methods

The Simulacrum: Decision-Theoretic Pretraining for Near-Optimal Time-Series Forecasting and Inference

arXiv:2606.27711v1 Announce Type: cross Abstract: We introduce a neural network-based framework for learning time series estimators through a process we term decision-theoretic pretraining. Analysts s

WattLayer: Get Layers Right to Estimate Inference Energy of Neural Networks

arXiv:2606.27841v1 Announce Type: cross Abstract: The widespread adoption of Artificial Intelligence (AI) has led to increasing concerns about energy consumption, yet there is a lack of standardized m

Agents

Rethinking Training & Inference for Forecasting: Linking Winner-Take-All back to GMMs

arXiv:2606.26424v1 Announce Type: cross Abstract: Trajectory forecasting for autonomous driving has advanced rapidly, yet representative models often produce uninformative posteriors over forecast mod

agentsarxiv-cs-cv

26 Jun 2026

SharQ: Bridging Activation Sparsity and FP4 Quantization for LLM Inference

arXiv:2606.26587v1 Announce Type: cross Abstract: Low-bit floating-point formats and semi-structured sparsity are increasingly supported by modern accelerators, yet combining them for LLM activation c

26 Jun 2026

TGHE: Template-based Graph Homomorphic Encryption for Privacy-Preserving GNN Inference in Edge-Cloud Systems

arXiv:2606.26664v1 Announce Type: cross Abstract: Existing homomorphic encryption (HE)-based GNN systems adopt a graph-centric paradigm that couples per-query cost to global graph size, limiting evalu

local-aiarxiv-cs-ai

26 Jun 2026

Semantic Allocation in Ordered Bottlenecks: Predictive Residual Inference for Visual Representation Learning

arXiv:2606.25232v1 Announce Type: cross Abstract: Ordered bottlenecks aim to provide utility at flexible budgets by assigning coarse information to early tokens and task-relevant detail to later ones.

researcharxiv-cs-cv

25 Jun 2026

Applications

TRACER: Training-Free Closed-Loop Structured Inference for Traffic Accident Reconstruction