Search: “inference”

arXiv:2605.09820v1 Announce Type: new Abstract: Diffusion language models (DLMs) have recently emerged as a promising alternative to autoregressive models, primarily due to their ability to enable par

local-aiarxiv-cs-lg

12 May 2026

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Applications

Finding Connections: Membership Inference Attacks for the Multi-Table Synthetic Data Setting

DGX agent

arXiv:2602.07126v2 Announce Type: replace Abstract: Synthetic tabular data has gained attention for enabling privacy-preserving data sharing. While substantial progress has been made in single-table s

applicationsarxiv-cs-lg

12 May 2026

Tutorials

From Regression to Inference: Meta-Learning Predictors for Neural Architecture Search

arXiv:2605.09290v1 Announce Type: new Abstract: Prediction-based approaches are widely used in neural architecture search (NAS), where a predictor estimates the performance of candidate architectures

tutorialsarxiv-cs-lg

12 May 2026

Zero-Shot Chinese Character Recognition via Global-Local Dual-Branch Alignment and Hierarchical Inference

model-releasesarxiv-cs-cv

arXiv:2605.08814v1 Announce Type: new Abstract: Chinese character categories are extremely large, and unseen characters frequently arise in open-world scenarios, making zero-shot Chinese character rec

12 May 2026

Agents

A Differentiable Bayesian Relaxation for Latent Partial-Order Inference

arXiv:2605.06976v1 Announce Type: cross Abstract: Many ranking and agent trace datasets are recorded as linear orders even though their latent structure is only partially ordered. This is especially c

agentsarxiv-cs-lg

Emergent social transmission of model-based representations without inference

arXiv:2604.05777v2 Announce Type: replace Abstract: How do people acquire rich, flexible knowledge about their environment from others despite limited cognitive capacity? Humans are often thought to r

GraphReAct: Reasoning and Acting for Multi-step Graph Inference

arXiv:2605.07357v1 Announce Type: new Abstract: Reasoning-acting frameworks enhance large language models (LLMs) by interleaving reasoning with actions for dynamic information acquisition. However, ex

PISTO: Proximal Inference for Stochastic Trajectory Optimization

arXiv:2605.07215v1 Announce Type: new Abstract: Stochastic trajectory optimization methods like STOMP enable planning with non-differentiable costs, offering substantial flexibility over gradient-base

researcharxiv-cs-ro

Tutorials

Statistical inference with belief functions: A survey

arXiv:2605.07908v1 Announce Type: cross Abstract: Belief functions are a powerful and popular framework for the mathematical characterisation of uncertainty, in particular in situations in which lack

tutorialsarxiv-cs-ai

Budgeted LoRA: Distillation as Structured Compute Allocation for Efficient Inference

model-releasesarxiv-cs-cl

arXiv:2605.04341v1 Announce Type: cross Abstract: We study distillation for large language models under explicit compute constraints, with the goal of producing student models that are not only cheape

Membership Inference Attacks for Retrieval Based In-Context Learning for Document Question Answering

arXiv:2605.04116v1 Announce Type: cross Abstract: We show that remotely hosted applications employing in-context learning when augmented with a retrieval function to select in-context examples can be

Applications

Quantization and Fast Inference (MEAP) - How much performance are you actually getting from quantization in production? [D]

applicationsr-machinelearning

This discussion examines the practical performance gains of quantization techniques when deployed in production environments, particularly addressing whether theoretical speedups translate to real-wor

ReasoningGuard: Safeguarding Large Reasoning Models with Inference-time Safety Aha Moments

arXiv:2508.04204v2 Announce Type: replace Abstract: Large Reasoning Models (LRMs) have demonstrated impressive performance in reasoning-intensive tasks, but they remain vulnerable to harmful content g

safetyarxiv-cs-cl

Scalable inference of spatial regions and temporal signatures from time series

arXiv:2605.05008v1 Announce Type: cross Abstract: Regionalization aims to partition a spatial domain into contiguous regions that share similar characteristics, enabling more effective spatial analysi

safetyarxiv-cs-lg

Uncertainty-Aware Trip Purpose Inference from GPS Trajectories via POI Semantic Zones and Pareto Calibration

arXiv:2605.01257v1 Announce Type: new Abstract: Large-scale GPS trajectory data offer rich observations of human mobility, yet assigning trip purposes to detected stops remains challenging due to the

6 May 2026

Revisiting Semantic Role Labeling: Efficient Structured Inference with Dependency-Informed Analysis

arXiv:2605.02505v1 Announce Type: new Abstract: Semantic Role Labeling (SRL) provides an explicit representation of predicate-argument structure, capturing linguistically grounded relations such as wh

researcharxiv-cs-cl

5 May 2026

ViM-Q: Scalable Algorithm-Hardware Co-Design for Vision Mamba Model Inference on FPGA

arXiv:2605.01935v1 Announce Type: cross Abstract: Vision Mamba (ViM) models offer a compelling efficiency advantage over Transformers by leveraging the linear complexity of State Space Models (SSMs),

hardwarearxiv-cs-cv

5 May 2026

WindowQuant: Mixed-Precision KV Cache Quantization based on Window-Level Similarity for VLMs Inference Optimization

arXiv:2605.02262v1 Announce Type: cross Abstract: Recently, video language models (VLMs) have been applied in various fields. However, the visual token sequence of the VLM is too long, which may cause

hardwarearxiv-cs-cl

5 May 2026

A Framework for Variational Inference of Lightweight Bayesian Neural Networks with Heteroscedastic Uncertainties

arXiv:2402.14532v2 Announce Type: replace Abstract: Obtaining heteroscedastic predictive uncertainties from a Bayesian Neural Network (BNN) is vital to many applications. Often, heteroscedastic aleato

Debiasing Reward Models via Causally Motivated Inference-Time Intervention

arXiv:2604.27495v1 Announce Type: cross Abstract: Reward models (RMs) play a central role in aligning large language models (LLMs) with human preferences. However, RMs are often sensitive to spurious

LLM-Guided Runtime Parameter Optimization for Energy-Efficient Model Inference

model-releasesarxiv-cs-lg

arXiv:2604.27032v1 Announce Type: cross Abstract: Large Language Models (LLMs) have become an integral part of many real-world workflows. However, LLMs consume a lot of energy, which becomes a large c

Applications

Position-Aware Drafting for Inference Acceleration in LLM-Based Generative List-Wise Recommendation

arXiv:2604.27747v1 Announce Type: cross Abstract: Large language model (LLM)-based generative list-wise recommendation has advanced rapidly, but decoding remains sequential and thus latency-prone. To

applicationsarxiv-cs-ai

Tutorials

Sequential Inference for Gaussian Processes: A Signal Processing Perspective

arXiv:2604.28163v1 Announce Type: cross Abstract: The proliferation of capable and efficient machine learning (ML) models marks one of the strongest methodological shifts in signal processing (SP) in

tutorialsarxiv-cs-lg

Inference-Time Scaling of Verification: Self-Evolving Deep Research Agents via Test-Time Rubric-Guided Verification

arXiv:2601.15808v2 Announce Type: replace Abstract: Recent advances in Deep Research Agents (DRAs) are transforming automated knowledge discovery and problem-solving. While the majority of existing ef

30 Apr 2026

Runpod launches Flash to bring AI inference to developers without infra overhead

model-releasessiliconangle

Developer-centered artificial intelligence cloud provider Runpod Inc. today announced the launch of Flash, a software development kit and platform that removes the infrastructure overhead for deployin

30 Apr 2026

One Refiner to Unlock Them All: Inference-Time Reasoning Elicitation via Reinforcement Query Refinement

arXiv:2604.25444v1 Announce Type: new Abstract: Large Language Models (LLMs) often fail to utilize their latent reasoning capabilities due to a distributional mismatch between ambiguous human inquirie

safetyarxiv-cs-cl

29 Apr 2026

Agents

Active Inference: A method for Phenotyping Agency in AI systems?

arXiv:2604.23278v1 Announce Type: new Abstract: The proliferation of agentic artificial intelligence has outpaced the conceptual tools needed to characterize agency in computational systems. Prevailin

agentsarxiv-cs-ai

Hamiltonian Graph Inference Networks: Joint structure discovery and dynamics prediction for lattice Hamiltonian systems from trajectory data

model-releasesarxiv-cs-lg

arXiv:2604.23606v1 Announce Type: new Abstract: Lattice Hamiltonian systems underpin models across condensed matter, nonlinear optics, and biophysics, yet learning their dynamics from data is obstruct

The Pragmatic Persona: Discovering LLM Persona through Bridging Inference

arXiv:2604.24079v1 Announce Type: cross Abstract: Large Language Models (LLMs) reveal inherent and distinctive personas through dialogue. However, most existing persona discovery approaches rely on su

Zoom In, Reason Out: Efficient Far-field Anomaly Detection in Expressway Surveillance Videos via Focused VLM Reasoning Guided by Bayesian Inference

arXiv:2604.23724v1 Announce Type: cross Abstract: Expressway video anomaly detection is essential for safety management. However, identifying anomalies across diverse scenes remains challenging, parti

Calibeating Prediction-Powered Inference

arXiv:2604.21260v1 Announce Type: cross Abstract: We study semisupervised mean estimation with a small labeled sample, a large unlabeled sample, and a black-box prediction model whose output may be mi

researcharxiv-cs-ai

24 Apr 2026

BatchLLM: Optimizing Large Batched LLM Inference with Global Prefix Sharing and Throughput-oriented Token Batching

arXiv:2412.03594v3 Announce Type: replace-cross Abstract: Large language models (LLMs) increasingly play an important role in a wide range of information processing and management tasks in industry. M

hardwarearxiv-cs-ai

23 Apr 2026

Resolving space-sharing conflicts in road user interactions through uncertainty reduction: An active inference-based computational model

arXiv:2604.19838v1 Announce Type: new Abstract: Understanding how road users resolve space-sharing conflicts is important both for traffic safety and the safe deployment of autonomous vehicles. While

23 Apr 2026

Dynamic Model Routing and Cascading for Efficient LLM Inference: A Survey

arXiv:2603.04445v2 Announce Type: replace-cross Abstract: The rapid growth of large language models (LLMs) with diverse capabilities, costs, and domains has created a critical need for intelligent mod

researcharxiv-cs-cl

22 Apr 2026

Visual Reasoning Agent: Robust Vision Systems in Remote Sensing via Inference-Time Scaling

arXiv:2509.16343v2 Announce Type: replace-cross Abstract: Building robust vision systems for high-stakes domains such as remote sensing requires stronger visual reasoning than what single-pass inferen

22 Apr 2026

A Sensitivity Approach to Causal Inference Under Limited Overlap

arXiv:2511.22003v2 Announce Type: replace-cross Abstract: Limited overlap between treated and control groups is a key challenge in observational analysis. Standard approaches like trimming importance

safetyarxiv-cs-lg

A Sugeno Integral View of Binarized Neural Network Inference

arXiv:2604.17967v1 Announce Type: cross Abstract: In this article, we establish a precise connection between binarized neural networks (BNNs) and Sugeno integrals. The advantage of the Sugeno integral

Inference-Time Temporal Probability Smoothing for Stable Video Segmentation with SAM2 under Weak Prompts

arXiv:2604.17115v1 Announce Type: new Abstract: Interactive video segmentation models such as SAM2 have demonstrated strong generalization across diverse visual domains. However, under weak user super

researcharxiv-cs-cv

Latent Phase-Shift Rollback: Inference-Time Error Correction via Residual Stream Monitoring and KV-Cache Steering

arXiv:2604.18567v1 Announce Type: cross Abstract: Large language models frequently commit unrecoverable reasoning errors mid-generation: once a wrong step is taken, subsequent tokens compound the mist

researcharxiv-cs-cl

Local Ai

Spatial-Regularization-Aware Dual-Branch Collaborative Inference for Training-Free OVSS in Remote Sensing Imagery

arXiv:2601.21159v2 Announce Type: replace Abstract: High-resolution remote sensing images contain densely distributed objects with pronounced scale variations and complex boundaries, which impose high

local-aiarxiv-cs-cv

Training-inference input alignment outweighs framework choice in longitudinal retinal image prediction

arXiv:2604.16955v1 Announce Type: new Abstract: Quantitative prediction of future retinal appearance from longitudinal imaging would support clinical decisions in progressive macular disease that curr

safetyarxiv-cs-cv

Agents

InfoChess: A Game of Adversarial Inference and a Laboratory for Quantifiable Information Control

arXiv:2604.15373v1 Announce Type: cross Abstract: We propose InfoChess, a symmetric adversarial game that elevates competitive information acquisition to the primary objective. There is no piece captu

agentsarxiv-cs-ai

20 Apr 2026

NeuroMesh: A Unified Neural Inference Framework for Decentralized Multi-Robot Collaboration

arXiv:2604.15475v1 Announce Type: new Abstract: Deploying learned multi-robot models on heterogeneous robots remains challenging due to hardware heterogeneity, communication constraints, and the lack

hardwarearxiv-cs-ro

20 Apr 2026

Ragged Paged Attention: A High-Performance and Flexible LLM Inference Kernel for TPU

arXiv:2604.15464v1 Announce Type: cross Abstract: Large Language Model (LLM) deployment is increasingly shifting to cost-efficient accelerators like Google's Tensor Processing Units (TPUs), prioritizi

20 Apr 2026

Generative Augmented Inference

arXiv:2604.14575v1 Announce Type: new Abstract: Data-driven operations management often relies on parameters estimated from costly human-generated labels. Recent advances in large language models (LLM

17 Apr 2026

Applications

Material-Agnostic Zero-Shot Thermal Inference for Metal Additive Manufacturing via a Parametric PINN Framework

arXiv:2604.14562v1 Announce Type: new Abstract: Accurate thermal modeling in metal additive manufacturing (AM) is essential for understanding the process-structure-performance relationship. While prio

applicationsarxiv-cs-lg

17 Apr 2026

FRTSearch: Unified Detection and Parameter Inference of Fast Radio Transients using Instance Segmentation

arXiv:2604.12344v1 Announce Type: cross Abstract: The exponential growth of data from modern radio telescopes presents a significant challenge to traditional single-pulse search algorithms, which are

15 Apr 2026

SOLARIS: Speculative Offloading of Latent-bAsed Representation for Inference Scaling

arXiv:2604.12110v1 Announce Type: new Abstract: Recent advances in recommendation scaling laws have led to foundation models of unprecedented complexity. While these models offer superior performance,