Search: “inference”

Identifying Informative Environments for Cognition Parameter Inference via Bayesian Experimental Design

arXiv:2607.28894v1 Announce Type: new Abstract: Computational cognitive modeling seeks to infer latent cognitive mechanisms underlying observed behavior. Bayesian inverse planning provides a principle

3 Aug 2026

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

Benchmarking LLM Competence on Logical Inference over Probability Operators

DGX agent

arXiv:2607.27405v1 Announce Type: new Abstract: Both expressions of uncertainty and inferences are ubiquitous in natural language, and valid inferences over natural-language expressions of uncertainty

model-releasesarxiv-cs-cl

31 Jul 2026

ACRL: Adaptive Control of Training-Inference Discrepancy for Stable Reinforcement Learning

arXiv:2607.24062v1 Announce Type: cross Abstract: Reinforcement Learning (RL) training for Large Language Models (LLMs) often suffers from instability due to the discrepancy between training and infer

safetyarxiv-cs-ai

28 Jul 2026

Demystifying Numerical Instability in LLM Inference: Achieving Reproducible Inference for Mission-Critical Tasks with HEAL

arXiv:2606.21023v1 Announce Type: new Abstract: As Large Language Models (LLMs) deploy into mission-critical domains (e.g., finance, medicine, and law), output reproducibility has become a strict syst

23 Jun 2026

Robust Privacy: Inference-Stage Privacy through Certified Robustness

arXiv:2601.17360v2 Announce Type: replace-cross Abstract: An adversary observing a model's released prediction can infer sensitive attributes of the queried input, or even reconstruct representatives

11 Jun 2026

CANS: Accelerating Multiuser Collaborative Edge Inference via Cooperative Autodidactic NeuroSurgeon

arXiv:2606.09175v1 Announce Type: cross Abstract: Recently, mobile edge computing (MEC)-enabled collaborative deep neural network (DNN) inference has emerged as a promising approach for delivering int

local-aiarxiv-cs-ai

9 Jun 2026

Mixing Vector Model for Copolymer Inference via Mixed Integer Linear Programming

arXiv:2605.29329v1 Announce Type: cross Abstract: A novel two-phase molecule inference framework, mol-infer, has recently been developed to infer chemical graphs with prescribed abstract structures an

29 May 2026

Distribution Transformers: Fast Approximate Bayesian Inference With On-The-Fly Prior Adaptation

arXiv:2502.02463v3 Announce Type: replace-cross Abstract: While Bayesian inference provides a principled framework for reasoning under uncertainty, its widespread adoption is limited by the intractabi

19 May 2026

When Less is Enough: Efficient Inference via Collaborative Reasoning

arXiv:2605.01111v1 Announce Type: cross Abstract: In this work, we introduce DUET (Dual-model Efficient Two-stage inference), a collaborative inference framework in which a capable model and a lightwe

researcharxiv-cs-cl

5 May 2026

Multimodal Remote Inference

arXiv:2508.07555v3 Announce Type: replace Abstract: We consider a remote inference system with multiple modalities, where a multimodal machine learning (ML) model performs real-time inference using fe

safetyarxiv-cs-lg

28 Apr 2026

Comparing energy consumption and accuracy in text classification inference

arXiv:2508.14170v2 Announce Type: replace Abstract: The increasing deployment of large language models (LLMs) in natural language processing (NLP) tasks raises concerns about energy efficiency and sus

researcharxiv-cs-cl

22 Apr 2026

Applications

An LLM-Guided Query-Aware Inference System for GNN Models on Large Knowledge Graphs

arXiv:2603.04545v2 Announce Type: replace Abstract: Efficient inference for graph neural networks (GNNs) on large knowledge graphs (KGs) is essential for many real-world applications. GNN inference qu

applicationsarxiv-cs-lg

21 Apr 2026

Tutorials

Hierarchical Active Inference using Successor Representations

arXiv:2604.15679v1 Announce Type: cross Abstract: Active inference, a neurally-inspired model for inferring actions based on the free energy principle (FEP), has been proposed as a unifying framework

tutorialsarxiv-cs-ai

20 Apr 2026

Learning Inference Concurrency in DynamicGate MLP Structural and Mathematical Justification

arXiv:2604.13546v1 Announce Type: new Abstract: Conventional neural networks strictly separate learning and inference because if parameters are updated during inference, outputs become unstable and ev

16 Apr 2026

Hardware

TensorCommitments: A Lightweight Verifiable Inference for Language Models

arXiv:2602.12630v2 Announce Type: replace-cross Abstract: Most large language models (LLMs) run on external clouds: users send a prompt, pay for inference, and must trust that the remote GPU executes

hardwarearxiv-cs-ai

2 Oct 2026

Applications

CIDER-FM: Foundation Models for Causal Inference from Diverse Experimental Regimes

arXiv:2609.39523v1 Announce Type: new Abstract: Causal foundation models (CFMs) amortise causal inference over priors of synthetic structural causal models (SCMs), predicting the effect of an experime

applicationsarxiv-cs-lg

1 Oct 2026

Hardware

Efficient World Action Model Inference with Adaptive Intermediate States

arXiv:2609.34608v1 Announce Type: new Abstract: World Action Models (WAMs) enable future-aware control by jointly modeling actions and environment dynamics. However, iterative diffusion or flow infere

hardwarearxiv-cs-ro

29 Sept 2026

Tutorials

EI-DDLGN: Efficient Encrypted Inference with Deep Differentiable Logic Gate Networks under TFHE

arXiv:2609.13636v1 Announce Type: cross Abstract: Privacy-preserving inference via Torus Fully Homomorphic Encryption (TFHE) provides strong protection for sensitive data in outsourced deep learning a

tutorialsarxiv-cs-lg

Sensory Precision Inference for Multimodal Arbitration under Uncertainty

arXiv:2609.15065v1 Announce Type: new Abstract: Autonomous agents operating on multisensory data cannot assume that all sensory modalities remain consistently informative. In real environments, sensor

agentsarxiv-cs-lg

Membership Inference via Pairwise Likelihood Ratios

arXiv:2609.12367v1 Announce Type: cross Abstract: Membership inference attacks (MIAs) are the standard tool for auditing the privacy risks of machine learning models. Given a query point, an MIA aims

14 Sept 2026

The Battery Price of edge AI: A study of the Environmental Impact of LLM Inference on Mobile Devices

arXiv:2609.11940v1 Announce Type: cross Abstract: The rapid diffusion of generative artificial intelligence raises privacy, latency, and performance concerns that motivate a shift toward 'local-first'

local-aiarxiv-cs-lg

14 Sept 2026

Beam Search, Self-Consistency, and the Limits of Inference-Time Scaling for Grammar-Constrained Text-to-SQL in Small Language Models

model-releasesarxiv-cs-cl

arXiv:2608.25761v1 Announce Type: new Abstract: One common trade-off in the use of large language models involves reducing the size of the model while increasing the amount of computation at inference

27 Aug 2026

Transformer Accelerator (TFA): A Macro-Op INT8 Hardware Chip for Transformer Inference and Machine Translation

arXiv:2608.23582v1 Announce Type: cross Abstract: We present the Transformer Accelerator (TFA), a synthesizable, parameterizable INT8 memory-to-memory engine for transformer inference. One time-multip

26 Aug 2026

VisCache: Visual KV Cache Pruning for Efficient Vision Large Language Model Inference

arXiv:2608.24063v1 Announce Type: cross Abstract: While Vision Large Language Models (VLLMs) have achieved remarkable success in multimodal reasoning, their long-context inference remains prohibitivel

26 Aug 2026

From Inference to Adaptation: A Unified Optimal Transport View of Vision Language Model

arXiv:2608.18339v1 Announce Type: cross Abstract: Vision-language models (VLMs) have demonstrated remarkable zero-shot capabilities yet remain sensitive to real-world distribution shifts during infere

safetyarxiv-cs-ai

20 Aug 2026

Online Inference in Distributional Temporal-Difference Learning

arXiv:2608.14408v1 Announce Type: cross Abstract: We study online statistical inference for functionals of the return distribution under a fixed policy. The return distribution is estimated by nonpara

local-aiarxiv-cs-lg

17 Aug 2026

VLASH: Real-Time VLAs via Future-State-Aware Asynchronous Inference

arXiv:2512.01031v2 Announce Type: replace-cross Abstract: Vision-Language-Action models (VLAs) are becoming increasingly capable across diverse robotic tasks. However, these models are typically deplo

28 Jul 2026

An Introduction to Bayesian and Frequentist Simulation-Based Inference with Machine Learning

arXiv:2607.21702v1 Announce Type: new Abstract: Simulation-based inference (SBI) with machine learning is an increasingly important tool for solving inverse problems in science and engineering, includ

27 Jul 2026

BaseRT: Best-in-Class LLM Inference on Apple Silicon via Native Metal

arXiv:2607.00501v1 Announce Type: cross Abstract: We present BaseRT, a native Metal inference runtime for large language models (LLMs) on Apple Silicon, and report the highest inference throughput on

2 Jul 2026

Fingerprinting Inference Systems of Large Language Models

arXiv:2605.29979v1 Announce Type: cross Abstract: The behavior of LLMs does not depend solely on the model itself. Components of the inference system, such as the inference engine, attention backend,

29 May 2026

Inference Time Policy Optimization for Offline RL with Differentiable World Models

arXiv:2603.22430v2 Announce Type: replace Abstract: Offline Reinforcement Learning (RL) learns optimal policies from fixed datasets, training a policy once and deploying it at inference time without f

safetyarxiv-cs-lg

21 May 2026

Information-Preserving Domain Transfer with Unlabeled Data in Misspecified Simulation-Based Inference

arXiv:2605.05652v2 Announce Type: replace Abstract: Simulation-based inference (SBI) provides amortized Bayesian parameter inference from simulator-generated data without requiring explicit likelihood

18 May 2026

Applications

SecureRouter: Encrypted Routing for Efficient Secure Inference

arXiv:2604.15499v1 Announce Type: cross Abstract: Cryptographically secure neural network inference typically relies on secure computing techniques such as Secure Multi-Party Computation (MPC), enabli

applicationsarxiv-cs-ai

20 Apr 2026

Privacy Against Agnostic Inference Attacks in Vertical Federated Learning

arXiv:2302.05545v4 Announce Type: replace-cross Abstract: A novel form of inference attack in vertical federated learning (VFL) is proposed, where two parties collaborate in training a machine learnin

agentsarxiv-cs-lg

14 Apr 2026

Tutorials

Exploiting Gradients in Bayesian Inference of Expensive Simulators

arXiv:2610.12076v1 Announce Type: new Abstract: Simulators based on differential equations are ubiquitous in science and engineering. They are often used in simulation-based inference to evaluate the

tutorialsarxiv-cs-lg

9 Oct 2026

Belief-Based Maximum Occupancy Principle and Active Inference

arXiv:2609.39342v1 Announce Type: cross Abstract: Intrinsic motivation plays a central role in adaptive and goal-directed behavior by conferring agents reward-independent objectives and biases useful

agentsarxiv-cs-ai

1 Oct 2026

Hardware

SparLeak: Privacy Leakage from Sparse Attention in LLM Inference on Shared GPUs

arXiv:2609.38830v1 Announce Type: new Abstract: Sparse attention is widely used to accelerate long-context inference in modern large language models (LLMs), but its input-dependent execution behavior

hardwarearxiv-cs-lg

1 Oct 2026

Scalable Diffusion SBI for Compositional Inference under Simulator Misspecification

arXiv:2609.36950v1 Announce Type: new Abstract: Simulation-based inference is challenging when many heterogeneous observations must be composed, hierarchical latent structure must be preserved, and th

local-aiarxiv-cs-lg

30 Sept 2026

Simulation-Based Quantum System Inference with Neural Posterior Estimation

arXiv:2609.34995v1 Announce Type: cross Abstract: Models of quantum systems faithfully map system parameters to observations, but the inverse problem of parameter inference from measurement data prese

29 Sept 2026

On Probabilistic Inference Through Parametric Tensor Decomposition in Base Tensor Networks

arXiv:2609.23774v1 Announce Type: new Abstract: Probabilistic inference is generally only tractable in low-treewidth graphical models, limiting its effective applicability in high-treewidth settings.

23 Sept 2026

Comparative Characterization of KV Cache Management Strategies for LLM Inference

arXiv:2604.05012v2 Announce Type: replace-cross Abstract: Efficient inference with Large Language Models (LLMs) increasingly relies on Key-Value (KV) caches to store previously computed key and value

16 Sept 2026

LLM Inference in a Flash!

arXiv:2609.16161v1 Announce Type: new Abstract: Large Language Models (LLMs) have shown impressive capabilities across a range of natural language processing tasks, and LLM inference has emerged as a

16 Sept 2026

Proportional-Fair Resource Allocation and Dual-Threshold Early-Exit Inference for Secure Cooperative Multi-Layer Edge Intelligence

model-releasesarxiv-cs-cv

arXiv:2609.15847v1 Announce Type: cross Abstract: This paper proposes FREDI (Fair Resource Allocation for Edge Dual-Threshold Inference), a secure wireless edge-intelligence framework for event-trigge

SpliTEE: Improving LLM Inference on Trusted Hardware with Differentially Private GPU Outsourcing

arXiv:2609.15039v1 Announce Type: cross Abstract: User prompts provided to large language models (LLMs) may contain sensitive or private information that can be misused by remotely deployed models, su

Field-level weak lensing cosmology with 60 simulations using multifidelity simulation-based inference

arXiv:2606.23346v2 Announce Type: replace-cross Abstract: We perform a realistic KiDS-Legacy mock analysis with field-level neural compression and simulation-based inference using just 60 N-body simul

10 Sept 2026

Who Are They to Each Other? Multi-Agent Reasoning for Speaker Relationship Inference

arXiv:2609.09628v1 Announce Type: cross Abstract: Inferring speaker relationships from spoken conversations is an important step towards socially aware speech understanding. However, this task remains

agentsarxiv-cs-cl

10 Sept 2026

A rigor-matched audit of periodic-step layer skipping for efficient llm inference: conflayers versus swift, with a supplemental analysis of trained routing alternatives

arXiv:2608.28846v1 Announce Type: cross Abstract: Layer-skipping methods for efficient LLM inference decide, at some granularity, which transformer layers to execute for a given input. We present a ri

1 Sept 2026

Pipeline-Native Transformers: Co-Designing Model Architecture and CPU Inference for Bandwidth-Efficient Autoregressive Decode

arXiv:2608.23841v1 Announce Type: cross Abstract: Single-token autoregressive decode on CPUs is bound by memory bandwidth, not arithmetic: a modern CPU sustains roughly 1 TFLOP/s of compute but only a