Search: “inference”

arXiv:2606.22601v1 Announce Type: cross Abstract: Gaussian Processes (GPs) are a powerful tool for Bayesian time-series modeling, yet their cubic computational cost remains a severe barrier for applic

tutorialsarxiv-cs-lg

23 Jun 2026

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Research

The Cost Geometry of Belief: finite-resource inference under noisy observation

DGX agent

arXiv:2606.21585v1 Announce Type: new Abstract: We equip the space of beliefs with a cost geometry (what it costs to pass from one belief to another): optimal transport in Wasserstein space, reweighte

researcharxiv-cs-lg

23 Jun 2026

TIP-Search: Time-Predictable Inference Scheduling for Market Prediction under Uncertain Load

arXiv:2506.08026v3 Announce Type: replace-cross Abstract: Real-time market prediction services need correct predictions before a decision deadline; a correct prediction delivered late is not a usable

safetyarxiv-cs-lg

23 Jun 2026

Universal priors: solving empirical Bayes via Bayesian inference and pretraining

arXiv:2602.15136v2 Announce Type: replace-cross Abstract: We theoretically justify the recent empirical finding of [Teh et al., 2025] that a transformer pretrained on synthetically generated data achi

23 Jun 2026

Hardware

HPE and Kamiwaza rethink AI infrastructure for the inference era

As AI factories evolve into “data centers of the future,” the infrastructure stack must also transform into a mix of CPU and GPU platforms that can deliver a full set of AI computing solutions. This r

hardwaresiliconangle

22 Jun 2026

Interpretable Neural Marked Statistics for Cosmological Inference

model-releasesarxiv-cs-lg

arXiv:2606.11295v1 Announce Type: cross Abstract: Recovering cosmological information beyond the power spectrum is a central goal for upcoming cosmological surveys, since late-time non-Gaussian signal

11 Jun 2026

LatticeBridge: Rare-Event Sequential Inference for Faithful Structured Sequence Synthesis

model-releasesarxiv-cs-cl

arXiv:2606.11203v1 Announce Type: new Abstract: Structured sequence generation often requires a model to satisfy several input-derived constraints in a single output. Standard decoding methods may ass

11 Jun 2026

Belief-Space Control for Personalized Cancer Treatment via Active Inference

arXiv:2606.10376v1 Announce Type: new Abstract: Cancer treatment is at the core a sequential decision-making problem with partial observability, latent patient heterogeneity, and explicit constraints

10 Jun 2026

Multi-task LLMs for Bug Classification: Efficient Inference with Auxiliary Decoding Heads

arXiv:2606.09956v1 Announce Type: cross Abstract: The rapid adoption of LLM-powered code generation has dramatically accelerated software development, yet effective verification methods remain severel

local-aiarxiv-cs-lg

10 Jun 2026

Industry

The Inference Alpha: Maximizing Frontier Models on AMD

This article discusses strategies for optimizing the performance of advanced AI frontier models when running on AMD hardware infrastructure. It likely covers deployment best practices, hardware config

industrydigitalocean

10 Jun 2026

Bayesian Selective Latent Inference for Wastewater-First Influenza Monitoring

arXiv:2606.09433v1 Announce Type: new Abstract: Wastewater influenza surveillance can reveal community circulation before clinical reporting, but wastewater alone is not a fully identifiable proxy for

Hardware

BRAIN: Bayesian Reasoning via Active Inference for Agentic and Embodied Intelligence in Mobile Networks

arXiv:2602.14033v1 Announce Type: cross Abstract: Future sixth-generation (6G) mobile networks will demand artificial intelligence (AI) agents that are not only autonomous and efficient, but also capa

hardwarearxiv-cs-ai

Locally Adaptive Conformal Inference for Operator Models

arXiv:2507.20975v5 Announce Type: replace-cross Abstract: Operator models are regression algorithms between Banach spaces of functions. They have become an increasingly critical tool for spatiotempora

local-aiarxiv-cs-lg

Quantitative Promise Theory: Intentionality and Inference in Autonomous Agents

arXiv:2606.08552v1 Announce Type: new Abstract: I discuss some quantitative representations of Promise Theory for processes involving autonomous agents. Agent models are common in software systems, ma

Reward Shaping for (Inference-Time) Alignment: A Stackelberg Game Perspective

arXiv:2602.02572v2 Announce Type: replace-cross Abstract: Existing alignment methods directly use the reward model learned from user preference data to optimize an LLM policy, subject to KL regulariza

Training-Inference Kernel Contracts: Bounding Divergence in Post-Training and Deployment

arXiv:2606.07581v1 Announce Type: cross Abstract: A modern post-training pipeline often writes one symbol for its policy, pi_theta, while evaluating it through two different programs: a training kerne

Tutorials

Unlocking AI flexibility in Europe: A guide to cross-region inference for EU data processing and model access

With access to the latest generative AI models and high-performance accelerated compute in high global demand, AWS customers need tools to take advantage of model availability and capacity across mult

tutorialsaws-ml-blog

8 Jun 2026

FIDES: Faithful Inference via Deep Evidence Signals for Retrieval-Memory Conflict in RAG

arXiv:2606.05644v1 Announce Type: new Abstract: When retrieved evidence contradicts parametric memory, language models frequently ignore context and default to memorized priors -- a failure that under

6 Jun 2026

Speculative Thinking: Enhancing Small-Model Reasoning with Large Model Guidance at Inference Time

arXiv:2504.12329v2 Announce Type: replace-cross Abstract: Recent advances leverage post-training to enhance model reasoning performance, which typically requires costly training pipelines and still su

4 Jun 2026

Approximating Probabilistic Inference in Statistical EL with Knowledge Graph Embeddings

arXiv:2407.11821v2 Announce Type: replace Abstract: Statistical information is ubiquitous but drawing valid conclusions from it is prohibitively hard. We explain how knowledge graph embeddings can be

Distribution-Calibrated Inference Time Compute for Thinking LLM-as-a-Judge

arXiv:2512.03019v2 Announce Type: replace-cross Abstract: Thinking Large Language Models (LLMs) used as judges for pairwise preferences remain noisy at the single-sample level, and common aggregation

Hallucinations as Orthogonal Noise: Inference-Time Manifold Alignment via Dynamic Contextual Orthogonalization

arXiv:2606.03022v1 Announce Type: cross Abstract: Hallucination in Large Language Models (LLMs), characterized by the generation of content inconsistent with contextual facts or logical constraints --

Inference-Time Scaling for Joint Audio-Video Generation

arXiv:2606.03183v1 Announce Type: cross Abstract: Joint audio-video generation aims to synthesize realistic audio-video pairs that are both semantically aligned with text prompts and precisely synchro

safetyarxiv-cs-cv

Latent Activation Editing: Inference-Time Refinement of Learned Policies for Safer Multirobot Navigation

arXiv:2509.20623v2 Announce Type: replace Abstract: Reinforcement learning has enabled significant progress in complex domains such as coordinating and navigating multiple quadrotors. However, even we

safetyarxiv-cs-ro

OASIS: Outlier-Aware LUT-Based GEMM with Dual-Side Quantization for LLM Inference Acceleration

arXiv:2507.23035v4 Announce Type: replace Abstract: Large language models (LLMs) have demonstrated impressive capabilities across a wide range of applications, but demand substantial memory and comput

Planning with Uncertainty: Symmetries, Policy Inference, and Solution Compression

arXiv:2403.19883v2 Announce Type: replace Abstract: Fully-observable non-deterministic (FOND) planning is at the core of artificial intelligence planning with uncertainty. It models uncertainty throug

VidMsg: A Benchmark for Implicit Message Inference in Short Videos

arXiv:2606.03635v1 Announce Type: cross Abstract: Understanding short online videos involves more than identifying visible objects and actions; video makers often include an underlying message or purp

Bayesian Inference of Nonlinear Malaria Dynamics in Ghana via an Ensemble Markov Chain Monte Carlo Sampler

arXiv:2606.00783v1 Announce Type: cross Abstract: Reliable quantification of malaria dynamics in sub-Saharan Africa is hindered by short, noisy, and spatially heterogeneous surveillance records. In Gh

DyLLM: Efficient Diffusion LLM Inference via Saliency-based Token Selection and Partial Attention

arXiv:2603.08026v2 Announce Type: replace-cross Abstract: Masked diffusion language models enable parallel token decoding, providing a promising alternative to the sequential nature of autoregressive

EPIC: Efficient and Parallel Inference under CFG Constraints for Diffusion Language Models

arXiv:2606.00722v1 Announce Type: cross Abstract: Controlling language model outputs is essential for ensuring structural validity, reliability, and downstream usability, and diffusion language models

Federated Learning via Variational Bayesian Inference: Personalization, Sparsity and Clustering

arXiv:2303.04345v2 Announce Type: replace Abstract: Federated learning (FL) is a promising framework that models distributed machine learning while protecting the privacy of clients. However, FL suffe

Implicit Geographic Inference in LLM Medical Triage: Language-Driven Disparities in Emergency Recommendations

arXiv:2606.01204v1 Announce Type: cross Abstract: We investigate whether large language models produce different medical triage recommendations for identical symptoms based solely on the language of t

MURMUR: An Efficient Inference System for Long-Form ASR

arXiv:2606.01483v1 Announce Type: cross Abstract: Long-form automatic speech recognition (ASR) requires both high accuracy and low latency, but existing systems force a trade-off between the two. Chun

Optimal Bayesian Stopping for Efficient Inference of Consistent LLM Answers

arXiv:2602.05395v2 Announce Type: replace-cross Abstract: A simple strategy for improving LLM accuracy, especially in math and reasoning problems, is to sample multiple responses and submit the answer

PathCRF: Ball-Free Soccer Event Detection via Possession Path Inference from Player Trajectories

arXiv:2602.12080v2 Announce Type: replace Abstract: Despite recent advances in AI, event data collection in soccer still relies heavily on labor-intensive manual annotation. Although prior work has ex

Tutorials

Prior-Guided Multi-Omic Transformers for Single-Cell Gene Regulatory Network Inference

arXiv:2606.00685v1 Announce Type: new Abstract: Gene regulatory networks (GRNs) capture transcription factor-target interactions and are central to understanding cell-state regulation and disease. Rec

tutorialsarxiv-cs-lg

Bayesian Inference with Shaped Deep Non-linear MLPs

arXiv:2605.30860v1 Announce Type: cross Abstract: A central aim of deep learning theory is to characterize how neural networks make predictions in the regime of simultaneously large model and training

Correcting Split Selection in Online Decision Trees via Anytime-Valid Inference

arXiv:2605.31239v1 Announce Type: cross Abstract: Bagging-based ensembles, most notably Adaptive Random Forests, are among the strongest performers for learning from data streams. A common denominator

Divergence Decoding: Inference-Time Unlearning via Auxiliary Models

arXiv:2605.31293v1 Announce Type: new Abstract: Large Language Models (LLMs) frequently memorize sensitive training data thereby creating significant privacy and copyright risks. Addressing these risk

researcharxiv-cs-cl

From Weak Cues to Real Identities: Evaluating Inference-Driven De-Anonymization in LLM Agents

arXiv:2603.18382v2 Announce Type: replace Abstract: Anonymization is often assumed to protect privacy once explicit identifiers are removed, because re-identification has historically required special

Light Interaction: Training-Free Inference Acceleration for Interactive Video World Models

arXiv:2605.31158v1 Announce Type: new Abstract: Interactive video world models generate video chunk by chunk in response to user-controlled camera movements, enabling applications such as real-time ga

local-aiarxiv-cs-cv

On-Device Robotic Planning: Eliminating Inference Redundancy for Efficient Decision-Making

arXiv:2605.31460v1 Announce Type: new Abstract: Reasoning-based robotic policies using large language and vision-language models achieve strong semantic planning capabilities but mostly suffer from a

local-aiarxiv-cs-ro

Position-Blind Ptychography: Viability of image reconstruction via data-driven variational inference

arXiv:2509.25269v3 Announce Type: replace-cross Abstract: In this work, we present and investigate the novel blind inverse problem of position-blind ptychography, i.e., ptychographic phase retrieval w

researcharxiv-cs-cv

Industry

The Inference Tax: How Prefix-Aware Routing Eliminates the Hidden Cost of LLMs at Scale

This article discusses how prefix-aware routing and prefix caching techniques can reduce the computational overhead and costs associated with running large language models at scale by eliminating redu

industrydigitalocean

TRINE: A Token-Aware, Runtime-Adaptive FPGA Inference Engine for Multimodal AI

arXiv:2603.22867v1 Announce Type: cross Abstract: Multimodal stacks that mix ViTs, CNNs, GNNs, and transformer NLP strain embedded platforms because their compute/memory patterns diverge and hard real

Auditing Training Data in Generative Music Models via Black-Box Membership Inference

arXiv:2605.29202v1 Announce Type: new Abstract: Recent advances in text-to-music generation enable high-fidelity synthesis of structured musical audio, raising growing concerns about data provenance,

safetyarxiv-cs-lg

29 May 2026

Hardware

Comprehensive observability for Amazon SageMaker AI LLM inference: From GPU utilization to LLM quality

This post demonstrates a comprehensive observability solution using Amazon Managed Grafana dashboards that provides a holistic view of both quality and quantity for LLMs served on Amazon SageMaker AI

hardwareaws-ml-blog

29 May 2026

Enhancing Membership Inference Attacks on Diffusion Models from a Frequency-Domain Perspective

arXiv:2505.20955v4 Announce Type: replace-cross Abstract: Diffusion models have achieved tremendous success in image generation, but they also raise significant concerns regarding privacy and copyrigh