Search: “inference”

The Shadow Price of Intelligence: Quality Degradation in LLM Inference as a Supply Chain Problem

arXiv:2608.23986v1 Announce Type: cross Abstract: Large language model providers are compute constrained, and their universal response to congestion is to degrade service: route queries to smaller mod

26 Aug 2026

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Local Ai

Barycentric Fused Gromov-Wasserstein Balancing for Causal Inference under Multiple Treatments

DGX agent

arXiv:2608.22024v1 Announce Type: cross Abstract: Estimating heterogeneous single and interaction treatment effects from observational data under multiple simultaneous treatments is crucial for decisi

local-aiarxiv-cs-ai

25 Aug 2026

Evaluating Inference-Time Defenses Against Package Hallucination in LLM-Generated Code

arXiv:2608.22652v1 Announce Type: cross Abstract: LLMs are increasingly used for code generation, yet they frequently hallucinate non-existent software packages, creating exploitable entry points into

researcharxiv-cs-ai

KVBoost: Chunk-Level Key-Value Cache Reuse with Deviation-Guided Recomputation for Efficient Large Language Model Inference

model-releasesarxiv-cs-ai

arXiv:2608.21362v1 Announce Type: new Abstract: Transformer-based large language models (LLMs) incur high prefill latency because key-value (KV) tensors must be recomputed for each request. Existing p

NeuroPrefetcher: Storage-Aware Sparse LLM Inference via Delta Prefetching

arXiv:2608.22643v1 Announce Type: cross Abstract: Deploying large language models on edge devices is increasingly limited by a widening gap between model size and available memory. Existing approaches

New: Llama.cpp adaptive speculation for faster inference

model-releasesr-localllama

We have been working on some performance optimisations for Qwen3.8 and other models. The main new feature that we introduced is adaptive speculation for Llama.cpp What is it? MTP and DFlash work well

Agents

Can you see how I learn? Human observers' inferences about Reinforcement Learning agents' learning processes

arXiv:2506.13583v2 Announce Type: replace-cross Abstract: Reinforcement Learning (RL) agents often exhibit learning behaviors that are not intuitively interpretable by human observers, which can resul

agentsarxiv-cs-ai

24 Aug 2026

Hardware

Valid Inference with Synthetic Data via Task Exchangeability

arXiv:2606.13629v2 Announce Type: replace-cross Abstract: There is a proliferation of work arguing for the use of synthetic data in scientific research. For example, social scientists are arguing for

hardwarearxiv-cs-ai

24 Aug 2026

From Street View Imagery to Street Quality Indicators: Vision Language Inference for the Suburban 15-minute City

arXiv:2608.20026v1 Announce Type: new Abstract: Streetscape quality has become a central concern in contemporary urban planning, particularly within the framework of the pedestrian-friendly 15-minute

applicationsarxiv-cs-cv

21 Aug 2026

SenseNova U1.5-Lite full release: expert training, OPD distillation, one model at inference

model-releasesr-localllama

Benchmarks: Benchmark U1 Preview Full Qwen-Image-Bench 47.14 55.20 (PE) 60.18 (PE) ImgEdit 3.9 4.37 4.59 GEdit-Bench-EN 7.47 8.14 8.26 Instead of just scaling up, they train task-specialized expert mo

21 Aug 2026

Where Grounding Accuracy Lives on the IoU Curve: Label-Free Inference-Time Boundary Refinement

model-releasesarxiv-cs-cv

arXiv:2608.19553v1 Announce Type: new Abstract: Vision--language models can identify the correct referent while returning an imprecise bounding box. We study whether a frozen direct-answer model can u

21 Aug 2026

Efficient INT8 Inference of Small NLP Models on Server CPUs with PyTorch Native Stack

arXiv:2608.18182v1 Announce Type: new Abstract: Small NLP models, especially BERT-family encoders, remain important in industrial workloads such as classification, ranking, and retrieval even in the e

researcharxiv-cs-cl

20 Aug 2026

Monroe: A Molecular Foundation Model for In-Context Probabilistic Inference

arXiv:2608.18982v1 Announce Type: new Abstract: Bioassay activity prediction is often data-limited because drug-discovery datasets rely on time-consuming and expensive wet-lab experiments for data gen

researcharxiv-cs-lg

20 Aug 2026

Same Facts, Different Updates: Inference Setup Shapes LLM Behavior in Medical Allocation

arXiv:2608.18108v1 Announce Type: cross Abstract: Large language models are being incorporated into sensitive and important decision-making processes across nearly all fields. While prior work studies

20 Aug 2026

Inference-Time Attention Steering for Vision-Language-Action Driving Models

arXiv:2608.17095v1 Announce Type: new Abstract: Vision-language-action (VLA) driving models couple a reasoning stage with a diffusion-based trajectory decoder, but do not give a direct way to redirect

local-aiarxiv-cs-cv

19 Aug 2026

Imagining Recovery: Inference-Time Counterfactual Realignment for Vision-Language-Action Models

arXiv:2608.14822v1 Announce Type: cross Abstract: Vision-language-action (VLA) models have improved the flexibility and generality of robotic manipulation, yet they remain fragile to online disruption

18 Aug 2026

Inference-Time Mitigation of Adversarial Political Bias in Large Language Models

arXiv:2608.14629v1 Announce Type: cross Abstract: As Large Language Models (LLMs) become the mainstay for information retrieval and summarization tasks, ensuring that they are always non-partisan and

18 Aug 2026

The Note-Chord-Voice Framework: Structured Source Separation and Causal Inference for EV Charging Data

arXiv:2608.14756v1 Announce Type: cross Abstract: Real-world EV charging data exhibit three interlocking pathologies: hardware fragmentation (network timeouts and billing resets split sessions), physi

safetyarxiv-cs-lg

18 Aug 2026

CutClean: Neural Network Pruning for Privacy-Preserving Inference

arXiv:2608.13773v1 Announce Type: cross Abstract: Neural networks are increasingly deployed in high-stakes applications with growing privacy leakage concerns. We show that this privacy leakage can occ

applicationsarxiv-cs-ai

17 Aug 2026

FlashDrive: Flash Vision-Language-Action Inference for Autonomous Driving

model-releasesarxiv-cs-ai

arXiv:2608.12932v1 Announce Type: new Abstract: Vision-Language-Action (VLA) models promise to bring end-to-end reasoning to autonomous driving, but their computational cost remains far too high for r

14 Aug 2026

Generation as Auxiliary Supervision: Enhancing Visual Understanding at Zero Inference Overhead via Decoupled Embedding Prediction

arXiv:2608.12209v1 Announce Type: new Abstract: While Multimodal Large Language Models (MLLMs) have achieved remarkable progress, visual understanding and generation are typically treated as divergent

researcharxiv-cs-cv

13 Aug 2026

Probably Approximately Correct Maximum A Posteriori Inference

arXiv:2601.16083v2 Announce Type: replace-cross Abstract: Computing the conditional mode of a distribution, better known as the maximum a posteriori (MAP) assignment, is a fundamental task in probabil

researcharxiv-cs-ai

13 Aug 2026

Redistribution-based Cost Inference Improves Sparse Safe Offline RL

arXiv:2608.12306v1 Announce Type: cross Abstract: Safe offline RL typically assumes access to dense per-step cost annotations, but in practice supervisors provide only trajectory-level stop-feedback:

13 Aug 2026

Weighted Sequential Bayesian Inference for Non-Stationary Linear Contextual Bandits

arXiv:2307.03587v4 Announce Type: replace Abstract: In non-stationary linear contextual bandits, existing efficient algorithms typically rely on the Weighted Regularized Least-Squares (WRLS) estimator

researcharxiv-cs-lg

12 Aug 2026

Mask-aware inference with State-Space Models

arXiv:2603.04568v2 Announce Type: replace Abstract: Many real-world computer vision tasks, such as depth completion, must handle inputs with arbitrarily shaped regions of missing or invalid data. For

applicationsarxiv-cs-cv

11 Aug 2026

Path-dependent Discrete Amortized Inference

arXiv:2608.08644v1 Announce Type: new Abstract: We consider the problem of sampling compositional and discrete objects from a given unnormalized posterior distribution. Notably, recent studies have sh

11 Aug 2026

Newton-Schulz Retraction-Based Inference Enables Hidden Quantum Markov Models to Outperform Classical HMMs

arXiv:2608.06554v1 Announce Type: new Abstract: Hidden Markov models (HMMs) are widely used probabilistic models for discrete sequential data but can be limited when hidden dynamics are complex. Hidde

10 Aug 2026

Dual-space posterior sampling for Bayesian inference in constrained inverse problems

arXiv:2603.00393v2 Announce Type: replace-cross Abstract: Inverse problems constrained by partial differential equations are often ill-conditioned due to noisy, incomplete data or inherent non-uniquen

7 Aug 2026

From Sports to Safety: Benchmarking Proactive Risk Inference in MLLMs

model-releasesarxiv-cs-cl

arXiv:2608.05560v1 Announce Type: cross Abstract: Timely anticipation of physical hazards is essential for real-world safety, yet existing MLLM evaluations focus on harmful content or general risks, l

7 Aug 2026

Interpretable Fuzzy Inference for UAV Target Tracking Using Bounding-Box Geometry

arXiv:2608.04121v1 Announce Type: cross Abstract: Vision-based guidance of unmanned aerial vehicles (UAVs) toward unmanned ground vehicles (UGVs) supports cooperative aerial--ground robotics, but reli

local-aiarxiv-cs-ai

6 Aug 2026

Strengthening Target-Language Features: SAE-Based Steering for Multilingual Inference

model-releasesarxiv-cs-cl

arXiv:2608.04904v1 Announce Type: new Abstract: Multilingual large language models exhibit substantial performance differences across languages, while existing adaptation methods often require paramet

6 Aug 2026

SVI-DAG: A Structured Variational Inference Approach to Bayesian Causal Discovery

arXiv:2608.04930v1 Announce Type: cross Abstract: Bayesian causal discovery seeks to determine the posterior distribution of causal theories, which are interpreted as directed acyclic graphs (DAGs) th

researcharxiv-cs-ai

6 Aug 2026

Amortized Inference of Multi-Modal Posteriors using Likelihood-Weighted Normalizing Flows

arXiv:2512.04954v3 Announce Type: replace Abstract: We present a novel technique for amortized posterior estimation using Normalizing Flows trained with likelihood-weighted importance sampling. This a

Beyond Accuracy: Auditing Spatial Provenance in Visual Token Pruning for OCR-Critical MLLM Inference

model-releasesarxiv-cs-cv

arXiv:2608.00077v1 Announce Type: new Abstract: Visual-token pruning is usually judged by answer quality at a fixed retention budget. For text-rich multimodal large language models (MLLMs), this proto

HyperODE: Zero-Shot Surrogate for Simulation and Inference of Dynamical Systems

arXiv:2608.00852v1 Announce Type: new Abstract: Understanding and controlling complex dynamical systems often requires executing thousands of numerical simulations across vast parametric landscapes, w

Mitigating Visual Hallucinations in Multimodal Systems through Retrieval-Augmented Reliability-Aware Inference

arXiv:2606.15782v2 Announce Type: replace-cross Abstract: Multimodal large language models (MLLMs) have demonstrated strong capabilities in vision-language understanding and natural-language response

Uncertainty-Aware Simulation-Based Inference for Operations Research with Large Language Models

arXiv:2608.00019v1 Announce Type: new Abstract: Deploying large language models (LLMs) for operations research (OR) tasks remains challenging because correctness depends on a coherent modeling process

local-aiarxiv-cs-lg

Industry

Netflix co-founder backs $312M round for optical inference appliance maker Olix

Artificial intelligence hardware startup Olix Computing Ltd. today announced that it has raised 312 million in funding. The Series C round included contributions from Arm Holding plc, Netflix Inc. co-

industrysiliconangle

3 Aug 2026

OnlineCache: Learning Dynamic Caching Policies with Error Correction for Efficient Diffusion Inference

arXiv:2607.29398v1 Announce Type: new Abstract: Diffusion models have revolutionized generative tasks but incur high latency due to iterative denoising. While cache-based strategies accelerate inferen

local-aiarxiv-cs-lg

3 Aug 2026

FeatFix: Reuse What You Verify through Local Exact-Feature Correction for Faster Cached Diffusion Inference

arXiv:2607.27842v1 Announce Type: new Abstract: Diffusion models are widely used to generate high-quality images and videos, but their iterative denoising process remains computationally intensive. A

local-aiarxiv-cs-cv

31 Jul 2026

Inference-Time Agentic Decision Rules Beat Longer Evolving Search for Multi-Image Medical Reasoning

arXiv:2607.27564v1 Announce Type: new Abstract: Multi-image medical VQA is not merely a prompt-length problem; it is a fundamental challenge of agentic decision-making. Medical vision-language agents

31 Jul 2026

No Data Is Not No Risk: Visibility Aware Graph-Based Inference of Business Conduct Risk

arXiv:2607.26859v1 Announce Type: cross Abstract: The monitoring of business conduct risk is hindered by sparse, uneven, and visibility-biased data. Prior studies show that business conduct risk infor

researcharxiv-cs-lg

30 Jul 2026

Safety-Aware Cascaded Inference for Crop Damage Assessment with Controlled Error Trade-offs

arXiv:2607.25468v1 Announce Type: new Abstract: In picture-based agricultural insurance for smallholder farmers, missed damage detections carry substantially higher cost than false alarms: a farmer wh

29 Jul 2026

Act, Think or Abstain: Complexity-Aware Adaptive Inference for Vision-Language-Action Models

arXiv:2603.05147v2 Announce Type: replace Abstract: Current research on Vision-Language-Action (VLA) models predominantly focuses on enhancing generalization through reasoning techniques. While effect

researcharxiv-cs-cv

LithoFormer: A Robust Framework for Stratigraphic Inference via Transformers

arXiv:2607.22804v1 Announce Type: cross Abstract: Accurate geological characterization of subsurface reservoirs from well log data is essential to support projects such as carbon capture and storage (

applicationsarxiv-cs-ai

Similarity Is Not Logic: Factored Inference for Dual-Encoder Vision-Language Models

arXiv:2607.23052v1 Announce Type: cross Abstract: Dual-encoder vision-language models (VLMs) expose a similarity interface that enables zero-shot retrieval but fails compositional constraints: queries

researcharxiv-cs-cl

Verbalized Particle Posterior: Bayesian Inference over Natural Language Hypotheses

model-releasesarxiv-cs-cl

arXiv:2607.22961v1 Announce Type: cross Abstract: Verbalized Machine Learning (VML) parameterizes a model as a natural-language prompt that an LLM evaluates as f(x; theta). The framework is interpreta

CPU-only inference on a Celeron N5095 SBC: 6 models from 0.6B to 8B, benchmarked