Search: “inference”

LLM Judge Validation Under Sparse Overlap: From Inference to Design

arXiv:2609.31857v2 Announce Type: replace Abstract: Validating an LLM-as-a-judge requires estimating its agreement with humans, yet annotation budgets rarely allow every item to be multiply labeled. W

researcharxiv-cs-ai

30 Sept 2026

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Applications

AnyStep-WAM: Budget-Aligned Distillation and Adaptive Inference for World Action Models

DGX agent

arXiv:2609.33748v1 Announce Type: new Abstract: World-action models (WAMs) couple predictive visual modeling with action generation, typically relying on iterative denoising with a fixed denoising ste

applicationsarxiv-cs-ro

29 Sept 2026

Elastic Selective Spectral Hybrids for Train-Once, Export-Many Budgeted Inference

arXiv:2609.32486v1 Announce Type: new Abstract: Deploying a language model under different computing and latency budgets calls for compact models with different quality-cost trade-offs. Towards this e

GraphSelect for Budgeted Representation Selection in Multimodal Graph Inference

arXiv:2609.33561v1 Announce Type: new Abstract: Multimodal graph predictors combine text, images, and relations to classify connected entities. How much of this input is needed to preserve their predi

Seeing Parts, Reasoning about Worlds: Visual Inference under Partial Observation

arXiv:2609.32456v1 Announce Type: new Abstract: World modeling under partial observation requires reasoning about the complete worlds that remain compatible with limited visual evidence. Occluded obje

Singularities of Non-negative Matrix Factorization and their application to Bayesian inference

arXiv:2609.34043v1 Announce Type: cross Abstract: Non-negative matrix factorization (NMF) is a singular statistical model whose Bayesian asymptotics are governed by the real log canonical threshold (R

Query-Conditioned Prototype Adaptation for Cross-Domain Few-Shot Learning: Single-Query Inference, Controlled Comparisons, and Failure Modes

model-releasesarxiv-cs-cv

arXiv:2609.30769v1 Announce Type: new Abstract: Cross-domain few-shot learning requires adapting a classifier to a new visual domain from very few labelled examples without target-time parameter updat

28 Sept 2026

An Order-Theoretic Characterization of Consistent Inductive Inference

arXiv:2609.28551v1 Announce Type: cross Abstract: When can a learner make only finitely many prediction errors along every infinite sequence labeled by a fixed, unknown hypothesis? We characterize thi

Local Ai

Paging the Experts: A Reproducible Characterization of Flash-Backed MoE Inference on iPhone

arXiv:2609.29032v1 Announce Type: cross Abstract: Sparse activation reduces mixture-of-experts computation without eliminating the need to store all experts. We present Routide, a Swift/MLX runtime th

local-aiarxiv-cs-lg

SpaFactor: Lightweight Spatial Context-Aware Gene Program Modeling for Histology-to-Transcriptomics Inference

arXiv:2609.28563v1 Announce Type: new Abstract: Spatial transcriptomics (ST) profiles gene expression within tissue architecture, but its cost and experimental complexity limit routine use. Predicting

Task-Aware Spectral Pruning: A Mixture-of-Masks Framework for Efficient LLM Inference

arXiv:2609.29499v1 Announce Type: new Abstract: Static pruning imposes one sparse structure on every prompt, even though reasoning, retrieval, generation, coding, and translation can depend on differe

MicroQonv: Reshaping Convolution Tensors for Efficient Microscaling in Training and Inference

arXiv:2609.28358v1 Announce Type: cross Abstract: Microscaling quantization techniques are increasingly used to represent neural network parameters with 8 bits or fewer while preserving near-full prec

researcharxiv-cs-ai

24 Sept 2026

Scaling of Capability and Efficiency at Inference Time in Large Reasoning Models

arXiv:2609.27166v1 Announce Type: new Abstract: Capability and efficiency are two key dimensions of reasoning in large language models (LLMs). Capability refers to the ability to solve a given problem

24 Sept 2026

Hardware

Greedy Decoding Is Not Precision-Invariant: Cross-Precision Output Divergence in LLM Inference

arXiv:2609.26621v1 Announce Type: new Abstract: Greedy decoding from large language models is commonly treated as deterministic. We show it is not precision-invariant: the same model, prompt, and deco

hardwarearxiv-cs-lg

23 Sept 2026

Ultra-fast Neural Inference for Stochastic Gaussian Splatting Denoising

arXiv:2609.25604v1 Announce Type: new Abstract: Stochastic rendering eliminates the sorting and alpha blending process in Gaussian splatting, at the cost of introducing spatial noise. Formulating temp

23 Sept 2026

Zephyron: Integrated Design and Analytical Evaluation of a Solar-Assisted Mobile Manipulator for Multimodal Environmental Reconnaissance and Distributed Visual Inference

arXiv:2609.25709v1 Announce Type: new Abstract: Environmental reconnaissance needs mobile platforms that carry sensors, preserve measurement context, and return interpretable evidence under limited en

safetyarxiv-cs-ro

23 Sept 2026

HapticWAM: Distilling Imagined Touch into a World-Action Model without Inference-Time Tactile Sensing

arXiv:2609.23888v1 Announce Type: new Abstract: Contact-rich manipulation requires estimating forces, slip and contact geometry that can remain ambiguous in scene images. Optical tactile sensors provi

safetyarxiv-cs-ro

Leveraging Inference-Time Compute for Diffusion Models via Global Scheduling of Denoising Trajectories

arXiv:2609.22867v1 Announce Type: new Abstract: Diffusion models generate a sample by traversing a denoising trajectory, a sequence of stochastic noise-reduction steps that transforms pure noise into

Morpho-VITS: Variational Inference with Morphological Modeling for End-to-End Speech Synthesis of a Tonal Bantu Language

arXiv:2609.24310v1 Announce Type: cross Abstract: Text-to-speech models for Bantu tonal languages are challenged by a tonal system that is rooted in both the lexis (i.e., the inventory of words, stems

researcharxiv-cs-cl

RLVR is a Kernel, Not a Function: Statistical Inference for pass@k Crossovers

arXiv:2609.22547v1 Announce Type: cross Abstract: Reinforcement learning with verifiable rewards (RLVR) often improves pass@1 while falling behind its base model at larger sampling budgets k, a crosso

Applications

StateMem: Single-State Residual Memory with Adaptive Inference for Vision-Language-Action Policies

arXiv:2609.22684v1 Announce Type: cross Abstract: Memory-dependent robotic manipulation often requires later actions to use information from earlier interactions. Existing vision-language-action (VLA)

applicationsarxiv-cs-lg

Statistical Inference for Adversarial Training: Central Limit Theorems via Optimal Transport

arXiv:2609.22240v1 Announce Type: new Abstract: The purpose of this paper is to rigorously quantify the statistical and learning-theoretic properties of adversarial training models for classification.

SoftTri: Smooth Triangular Membership Functions for Adaptive Fuzzy Inference Systems

arXiv:2609.20194v1 Announce Type: cross Abstract: Triangular membership functions (MFs) are widely used in fuzzy systems because of their interpretability, low parameterization complexity, and strong

18 Sept 2026

Local Ai

Beyond Static RAG: An Adaptive, Tri-Metric Routing Framework for Efficient Long-Context Inference on Commodity GPUs

arXiv:2609.17564v1 Announce Type: new Abstract: Deploying retrieval-augmented generation (RAG) on commodity GPUs such as the NVIDIA T4 (16 GB VRAM) exposes a practical failure mode we call the Compres

local-aiarxiv-cs-lg

17 Sept 2026

From a River in Gilead to the Inference Distributions of Large Language Models: Covert Dialect Bias and Linguistic Profiling at Scale

arXiv:2609.18068v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly deployed in high-stakes domains such as housing screening. While alignment techniques mitigate explicit

safetyarxiv-cs-ai

17 Sept 2026

Differentiable Mesh State Estimation via Factor Graph Inference for Deformable Object Reconstruction

arXiv:2609.16686v1 Announce Type: cross Abstract: Estimating deformable object states remains a fundamental challenge in robotics and simulation. We propose a novel factor graph-based framework for pr

16 Sept 2026

Agents

From Momentary Emotion Inference to Sustained Emotion Support: Evaluating a Companion Agent in a Longitudinal Study

arXiv:2609.16344v1 Announce Type: cross Abstract: Sustained emotional support is a long-horizon interaction task closely tied to human well-being. Recent research demonstrates generative agents' capac

agentsarxiv-cs-ai

16 Sept 2026

Evaluation of optimisation and Bayesian inference methods for reaction rates in atmospheric chemical mechanisms

arXiv:2609.14569v1 Announce Type: cross Abstract: Constraining reaction rate coefficients is a central challenge in the development of explicit atmospheric chemical mechanisms, particularly for autoxi

15 Sept 2026

NeuroFlex: Lossless Element-Level ANN-SNN Co-Execution for Efficient Sparse Inference

arXiv:2609.14092v1 Announce Type: cross Abstract: Sparse DNN accelerators specialize in ANN or SNN execution, leaving energy or latency on the table when workload characteristics vary within a layer.

15 Sept 2026

FastE: Readout-Triggered Token Compression for LLM Embedding Inference

arXiv:2609.08407v1 Announce Type: new Abstract: In this study, we identify depth-dependent prefix redundancy in final-readout LLM embedding models, notably across representative backbones including Qw

safetyarxiv-cs-ai

10 Sept 2026

SymbolicLight V2: Hybrid Neuromorphic Architecture and Sparse Execution for Low-Energy Language Inference

model-releasesarxiv-cs-cl

arXiv:2609.09772v1 Announce Type: new Abstract: SymbolicLight V2 combines sparse event computation with continuous-state processing in a hybrid neuromorphic language architecture. Extending V1's spike

10 Sept 2026

Knowledge-Guided Vision-Language Inference for Image-Based Urban Flood Depth Estimation

arXiv:2509.04772v2 Announce Type: replace Abstract: Timely floodwater depth estimates support road accessibility assessment and emergency response during urban flooding. Supervised vision methods ofte

9 Sept 2026

Mind the Gap: Navigating Inference with Optimal Transport Maps

arXiv:2507.08867v3 Announce Type: replace-cross Abstract: Machine learning (ML) techniques have recently enabled enormous gains in sensitivity to new phenomena across the sciences. In particle physics

9 Sept 2026

ZetaDial: dialing net charge of protein binders at inference time for therapeutic developability

arXiv:2609.05451v1 Announce Type: cross Abstract: Net charge is a developability-relevant property of therapeutic binders, linked to viscosity, clearance, nonspecific interaction and aggregation, and

safetyarxiv-cs-lg

9 Sept 2026

Hardware

BeaconKV: Key-Value Cache Compression Guided by Beacon Queries for Efficient Large Reasoning Model Inference

arXiv:2609.04971v1 Announce Type: cross Abstract: Large Reasoning Models (LRMs) achieve superior problem-solving through extended Chain-of-Thought (CoT) generation, but the resulting key-value (KV) ca

hardwarearxiv-cs-cl

7 Sept 2026

Influence Score and Transformers interpretability: Measure of the Effective Impact of Attention Heads at inference time

arXiv:2609.05074v1 Announce Type: new Abstract: We propose an influence score to quantify the contribution of attention heads to classification decisions in Transformer-based models designed for promp

researcharxiv-cs-cl

7 Sept 2026

You Really Didn't Get That? Benchmarking Social Pragmatic Inference for Indirect and Playful Chinese Online Comments

arXiv:2609.04384v1 Announce Type: cross Abstract: Chinese online comments often convey social meaning through indirect and playful language that is hard to interpret without context. Existing evaluati

7 Sept 2026

NeoMME: A Single-Tower Multimodal-Native Multilingual Foundation Encoder for Efficient Fine-Tuning and Inference

arXiv:2609.01657v1 Announce Type: cross Abstract: Multimodal models often build on architectures designed for generative vision-language modeling, typically combining separately pretrained vision enco

3 Sept 2026

Compressing AI Traffic: Standardized Neural Network Coding of Visual-Token Representations in Split Vision-Language Inference

model-releasesarxiv-cs-cv

arXiv:2609.01200v1 Announce Type: new Abstract: When the visual encoder and the language decoder of a vision-language model (VLM) run on different compute nodes, the intermediate visual-token embeddin

2 Sept 2026

Ontology-Guided Neuro-Symbolic Inference: Grounding Language Models with Mathematical Domain Knowledge

arXiv:2602.17826v2 Announce Type: replace Abstract: Language models exhibit fundamental limitations -- hallucination, brittleness, and lack of formal grounding -- that are particularly problematic in

2 Sept 2026

Local Ai

Restrict, Don't Retrain: Inference-Time VLM Guidance for Zero-Shot Aerial Segmentation

arXiv:2609.00628v1 Announce Type: cross Abstract: Global welfare often depends on the correct interpretation of aerial and satellite imagery. Acting on such imagery (mapping flooded ground, crop exten

local-aiarxiv-cs-ai

2 Sept 2026

A homotopy-type-theoretic generalization of neurosymbolic inference

arXiv:2606.17851v2 Announce Type: replace Abstract: A wide range of neurosymbolic (NeSy) systems compute one functional: a belief-weighted sum of a logical quantity over a space of sigma-structures, o

researcharxiv-cs-ai

1 Sept 2026

Dependency-Aware Revocable Decoding for Efficient Diffusion Large Language Model Inference

arXiv:2608.26574v1 Announce Type: new Abstract: Diffusion large language models (dLLMs) offer a promising alternative to autoregressive generation by decoding multiple tokens in parallel through itera

researcharxiv-cs-cl

28 Aug 2026

G2D: Generative-to-Discriminative Collaborative Inference for Zero-Shot Image Classification

arXiv:2608.26744v1 Announce Type: new Abstract: Zero-shot classification needs efficient label retrieval and fine-grained visual reasoning, yet discriminative and generative vision-language models fai

28 Aug 2026

Reflection Steering: Disentangling Reflection from Reasoning in Activation Space for Token-Efficient Inference

model-releasesarxiv-cs-cl

arXiv:2608.25542v1 Announce Type: cross Abstract: Large reasoning models often produce reasoning traces with verification, revision, and backtracking. When reflection merely re-checks established resu

27 Aug 2026

Asymptotically perfect seeded graph matching without edge correlation (and applications to inference)

arXiv:2506.02825v3 Announce Type: replace-cross Abstract: We present the OmniMatch algorithm for seeded multiple graph matching. In the setting of d-dimensional Random Dot Product Graphs (RDPG), we pr

26 Aug 2026

Applications

GNNBleed: Inference Attacks to Unveil Private Edges in Graphs with Realistic Access to GNN Models

arXiv:2311.16139v3 Announce Type: replace-cross Abstract: Graph Neural Networks (GNNs) have become indispensable tools for learning from graph structured data, catering to various applications such as

applicationsarxiv-cs-lg

26 Aug 2026

A Deep Causal Inference Approach to Measuring the Effects of Forming Group Loans in Online Non-profit Microfinance Platform

arXiv:1706.02795v1 Announce Type: cross Abstract: Kiva is an online non-profit crowdsouring microfinance platform that raises funds for the poor in the third world. The borrowers on Kiva are small bus