Search: “inference”

Pragmatic Curiosity: A Unified Framework for Hybrid Learning and Optimization via Active Inference

arXiv:2602.06104v2 Announce Type: replace Abstract: Many engineering and scientific workflows rely on expensive black-box evaluations, requiring sequential decisions that must both improve task perfor

14 May 2026

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Safety

SPOT: Selective Prompt Projection via Total Variation for Inference-Only Safe Text-to-Image Generation

DGX agent

arXiv:2602.00616v3 Announce Type: replace Abstract: Text-to-Image (T2I) diffusion models enable high quality open ended synthesis, but practical use requires suppressing unsafe generations while prese

safetyarxiv-cs-ai

14 May 2026

CATS: Cascaded Adaptive Tree Speculation for Memory-Limited LLM Inference Acceleration

arXiv:2605.11186v1 Announce Type: new Abstract: Auto-regressive decoding in Large Language Models (LLMs) is inherently memory-bound: every generation step requires loading the model weights and interm

13 May 2026

Efficient Bayesian Inference from Noisy Pairwise Comparisons

arXiv:2510.09333v2 Announce Type: replace-cross Abstract: Evaluating generative models is challenging because standard metrics often fail to reflect human preferences. Human evaluations are more relia

researcharxiv-cs-cv

13 May 2026

VIP: Visual-guided Prompt Evolution for Efficient Dense Vision-Language Inference

arXiv:2605.12325v1 Announce Type: new Abstract: Pursuing training-free open-vocabulary semantic segmentation in an efficient and generalizable manner remains challenging due to the deep-seated spatial

safetyarxiv-cs-cv

13 May 2026

DARE: Diffusion Language Model Activation Reuse for Efficient Inference

arXiv:2605.08134v1 Announce Type: cross Abstract: Diffusion Large Language Models (dLLMs) have emerged as a promising alternative to auto-regressive (AR) models, offering greater expressive capacity a

EnergyLens: Interpretable Closed-Form Energy Models for Multimodal LLM Inference Serving

model-releasesarxiv-cs-cv

arXiv:2605.10556v1 Announce Type: new Abstract: As large language models span dense, mixture-of-experts, and state-space architectures and are deployed on heterogeneous accelerators under increasingly

Local Ai

FedGMI: Generative Model-Driven Federated Learning for Probabilistic Mixture Inference

arXiv:2605.08760v1 Announce Type: new Abstract: Federated Learning (FL) facilitates collaborative model training across decentralized clients while preserving data privacy by avoiding raw data exchang

local-aiarxiv-cs-lg

Hardware

FlashSVD v1.5: Making Low-Rank Transformers Inference Actually Fast

arXiv:2605.08314v1 Announce Type: cross Abstract: SVD-based Low-rank compression reduces transformer parameters and nominal FLOPs, but these savings often translate poorly into real LLM serving speedu

hardwarearxiv-cs-ai

Mitigating Membership Inference in Intermediate Representations with Differentially Private Training

arXiv:2602.22611v2 Announce Type: replace Abstract: In Embedding-as-an-Interface (EaaI) settings, pre-trained models are queried for Intermediate Representations (IRs). The distributional properties o

Scalable Gaussian process inference via neural feature maps

arXiv:2605.10285v1 Announce Type: cross Abstract: We present a theoretically grounded Gaussian process framework that leverages neural feature maps to construct expressive kernels. We show that the le

Statistical Inference and Quality Measures of KV Cache Quantisations Inspired by TurboQuant

arXiv:2605.08114v1 Announce Type: new Abstract: We analyse three KV cache quantization schemes under a fair bit budget: extbf{KV} (scalar MSE baseline), extbf{KQV} (WHT + MSE on K; WHT + MSE + QJL on

Survey-aware Machine Learning: A Guideline for Valid Population Health Inference based on Scoping Review

arXiv:2605.08963v1 Announce Type: cross Abstract: Machine Learning (ML) models trained on complex health surveys such as the National Health and Nutrition Examination Survey (NHANES) often ignore prim

safetyarxiv-cs-lg

Beyond Distribution Estimation: Simplex Anchored Structural Inference Towards Universal Semi-Supervised Learning

arXiv:2605.07557v1 Announce Type: new Abstract: Semi-supervised learning faces significant challenges in realistic scenarios where labeled data is scarce and unlabeled data follows unknown, arbitrary

CLIPer: Tailoring Diverse User Preference via Classifier-Guided Inference-Time Personalization

arXiv:2605.07162v1 Announce Type: new Abstract: Personalized LLMs can significantly enhance user experiences by tailoring responses to preferences such as helpfulness, conciseness, and humor. However,

researcharxiv-cs-cl

SphereVAD: Training-Free Video Anomaly Detection via Geodesic Inference on the Unit Hypersphere

arXiv:2605.08003v1 Announce Type: new Abstract: Video anomaly detection (VAD) aims to automatically identify events that deviate from normal patterns in untrimmed surveillance videos. Existing methods

researcharxiv-cs-cv

Tacit Knowledge Extraction via Logic Augmented Generation and Active Inference

arXiv:2605.07639v1 Announce Type: new Abstract: Tacit knowledge plays a central role in human expertise, yet it remains difficult to capture, formalize, and reuse in machine-interpretable form. This c

applicationsarxiv-cs-ai

Three-in-One World Model: Energy-Based Consistency, Prediction, and Counterfactual Inference for Marketing Intervention

arXiv:2605.07199v1 Announce Type: new Abstract: Marketing decisions reflect the interaction of latent consumer heterogeneity, time-varying internal states, and explicit interventions, a structure that

TCM-Serve: Modality-aware Scheduling for Multimodal Large Language Model Inference

arXiv:2603.26498v2 Announce Type: replace-cross Abstract: Multimodal Large Language Models (MLLMs) power platforms like ChatGPT, Gemini, and Copilot, enabling richer interactions with text, images, an

7 May 2026

Power-Softmax: Towards Secure LLM Inference over Encrypted Data

arXiv:2410.09457v2 Announce Type: replace Abstract: Modern cryptographic methods for implementing privacy-preserving LLMs such as gls{HE} require the LLMs to have a polynomial form. Forming such a rep

safetyarxiv-cs-lg

6 May 2026

Two Calls, Two Moments, and the Vote-Accuracy Curve of Repeated LLM Inference

arXiv:2605.03379v1 Announce Type: cross Abstract: Repeated sampling is a standard way to spend test-time compute, but its benefit is controlled by the latent distribution of correctness across example

researcharxiv-cs-cl

6 May 2026

LiteVLA-H: Dual-Rate Vision-Language-Action Inference for Onboard Aerial Guidance and Semantic Perception

model-releasesarxiv-cs-cv

arXiv:2605.00884v1 Announce Type: new Abstract: Vision-language-action (VLA) models have shown strong semantic grounding and task generalization in manipulation, but aerial deployment remains difficul

Logit-KL Flow Matching: Non-Autoregressive Text Generation via Sampling-Hybrid Inference

arXiv:2411.16821v5 Announce Type: replace Abstract: Non-autoregressive (NAR) language models offer notable efficiency in text generation by circumventing the sequential bottleneck of autoregressive de

researcharxiv-cs-cl

RECAP: Transparent Inference-Time Emotion Alignment for Medical Dialogue Systems

arXiv:2509.10746v3 Announce Type: replace Abstract: Large language models in healthcare often produce emotionally flat or opaque responses, failing to provide the transparent reasoning required for cl

safetyarxiv-cs-cl

Hardware

Stochastic Sparse Attention for Memory-Bound Inference

arXiv:2605.01910v1 Announce Type: new Abstract: Autoregressive decoding becomes bandwidth-limited at long contexts, as generating each token requires reading all n_k key and value vectors from KV cach

hardwarearxiv-cs-lg

Weight Clipping for Robust Conformal Inference under Unbounded Covariate Shifts

arXiv:2605.02072v1 Announce Type: new Abstract: Conformal prediction (CP) provides powerful, distribution-free prediction sets, but its guarantees rely on the exchangeability of training and test data

applicationsarxiv-cs-lg

Who Decides What Is Harmful? Content Moderation Policy Through A Multi-Agent Personalised Inference Framework

arXiv:2605.01416v1 Announce Type: cross Abstract: The increasing scale and complexity of online platforms raises critical policy questions around harmful content, digital well-being, and user autonomy

safetyarxiv-cs-cl

SAGA: Workflow-Atomic Scheduling for AI Agent Inference on GPU Clusters

arXiv:2605.00528v1 Announce Type: cross Abstract: AI agents execute tens to hundreds of chained LLM calls per task, yet GPU schedulers treat each call as independent, discarding gigabytes of intermedi

safetyarxiv-cs-lg

4 May 2026

Statistical Testing Framework for Clustering Pipelines by Selective Inference

arXiv:2603.18413v3 Announce Type: replace-cross Abstract: A data analysis pipeline is a structured sequence of steps that transforms raw data into meaningful insights by integrating multiple analysis

4 May 2026

Reinforced Agent: Inference-Time Feedback for Tool-Calling Agents

arXiv:2604.27233v1 Announce Type: new Abstract: Tool-calling agents are evaluated on tool selection, parameter accuracy, and scope recognition, yet LLM trajectory assessments remain inherently post-ho

1 May 2026

TouchGuide: Inference-Time Steering of Visuomotor Policies via Touch Guidance

arXiv:2601.20239v4 Announce Type: replace Abstract: Fine-grained and contact-rich manipulation remain challenging for robots, largely due to the underutilization of tactile feedback. To address this,

safetyarxiv-cs-ro

1 May 2026

Tutorials

VIPaint: Image Inpainting with Pre-Trained Diffusion Models via Variational Inference

arXiv:2411.18929v2 Announce Type: replace-cross Abstract: Diffusion probabilistic models learn to remove noise added during training, generating novel data (e.g., images) from Gaussian noise through s

tutorialsarxiv-cs-ai

1 May 2026

Bridge: Basis-Driven Causal Inference Marries VFMs for Domain Generalization

model-releasesarxiv-cs-cv

arXiv:2604.26820v1 Announce Type: new Abstract: Detectors often suffer from degraded performance, primarily due to the distributional gap between the source and target domains. This issue is especiall

Local Ai

Hierarchical adaptive control for real-time dynamic inference at the edge

arXiv:2604.26470v1 Announce Type: new Abstract: Industrial systems increasingly depend on Machine Learning (ML), and operate on heterogeneous nodes that must satisfy tight latency, energy, and memory

local-aiarxiv-cs-lg

Inferix: A Block-Diffusion based Next-Generation Inference Engine for World Simulation

arXiv:2511.20714v2 Announce Type: replace-cross Abstract: World models serve as core simulators for fields such as agentic AI, embodied AI, and gaming, capable of generating long, physically realistic

Student Guides Teacher: Weak-to-Strong Inference via Spectral Orthogonal Exploration

arXiv:2601.06160v2 Announce Type: replace Abstract: Large Language Models (LLMs) often suffer from ''Reasoning Collapse'' on challenging mathematical reasoning tasks, where stochastic sampling produce

safetyarxiv-cs-ai

Variable Elimination in Hybrid Factor Graphs for Discrete-Continuous Inference & Estimation

arXiv:2601.00545v3 Announce Type: replace Abstract: Many problems in robotics involve both continuous and discrete components, and modeling them together for estimation tasks has been a long standing

applicationsarxiv-cs-ro

A Hierarchical Ensemble Inference Pipeline for Robust White Blood Cell Classification Under Domain Shifts

arXiv:2604.23271v1 Announce Type: new Abstract: Automated white blood cell (WBC) classification is essential for scalable leukaemia screening. However, real-world deployment is challenged by domain sh

applicationsarxiv-cs-cv

BERT-APC: A Reference-free Framework for Automatic Pitch Correction via Musical Context Inference

arXiv:2511.20006v2 Announce Type: replace-cross Abstract: Automatic Pitch Correction (APC) enhances vocal recordings by aligning pitch deviations with intended musical notes. However, existing APC sys

Flexible Deep Neural Networks for Partially Linear Survival Data: Estimation and Survival Inference

arXiv:2512.10570v2 Announce Type: replace-cross Abstract: We propose a flexible deep neural network (DNN) framework for modeling survival data within a partially linear regression structure. The appro

Scaling Multi-Node Mixture-of-Experts Inference Using Expert Activation Patterns

arXiv:2604.23150v1 Announce Type: cross Abstract: Most recent state-of-the-art (SOTA) large language models (LLMs) use Mixture-of-Experts (MoE) architectures to scale model capacity without proportion

Local Ai

Statistical Test for Diffusion-Based Anomaly Localization via Selective Inference

arXiv:2402.11789v5 Announce Type: replace-cross Abstract: Anomaly localization in images -- identifying regions that deviate from normal patterns -- is vital in applications such as medical diagnosis

local-aiarxiv-cs-cv

Mochi: Aligning Pre-training and Inference for Efficient Graph Foundation Models via Meta-Learning

arXiv:2604.22031v1 Announce Type: cross Abstract: We propose Mochi, a Graph Foundation Model that addresses task unification and training efficiency by adopting a meta-learning based training framewor

applicationsarxiv-cs-ai

27 Apr 2026

FairyFuse: Multiplication-Free LLM Inference on CPUs via Fused Ternary Kernels

arXiv:2604.20913v1 Announce Type: new Abstract: Large language models are increasingly deployed on CPU-only platforms where memory bandwidth is the primary bottleneck for autoregressive generation. We

Agents

OpInf-LLM: Parametric PDE Solving with LLMs via Operator Inference

arXiv:2602.01493v2 Announce Type: replace-cross Abstract: Solving diverse partial differential equations (PDEs) is fundamental in science and engineering. Large language models (LLMs) have demonstrate

agentsarxiv-cs-ai

TAPO-Description Logic for Information Behavior: Refined OBoxes, Inference, and Categorical Semantics

arXiv:2604.21172v1 Announce Type: cross Abstract: This paper develops a refined version of TAPO-description logic for the analysis of information behavior. The framework is treated not as a single hom

Toward Efficient Membership Inference Attacks against Federated Large Language Models: A Projection Residual Approach

arXiv:2604.21197v1 Announce Type: new Abstract: Federated Large Language Models (FedLLMs) enable multiple parties to collaboratively fine-tune LLMs without sharing raw data, addressing challenges of l

Dual Causal Inference: Integrating Backdoor Adjustment and Instrumental Variable Learning for Medical VQA

arXiv:2604.20306v1 Announce Type: cross Abstract: Medical Visual Question Answering (MedVQA) aims to generate clinically reliable answers conditioned on complex medical images and questions. However,