Search: “inference”

Diff Diffusion: Predicting Edit Paths with Diffusion Models for Efficient Code Editing

arXiv:2610.17831v1 Announce Type: cross Abstract: Diffusion large language models (dLLMs) are appealing for code generation because they can update many tokens in parallel, yet many are optimized for

local-aiarxiv-cs-ai

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

Empowering Edge Agents: A Systematic Analysis of Edge-Cloud Collaboration in LLM Agent Execution

DGX agent

arXiv:2610.17816v1 Announce Type: new Abstract: Edge-cloud collaboration combines the lower inference overhead and greater data locality of edge-side execution with the stronger capabilities of cloud-

model-releasesarxiv-cs-ai

15 Oct 2026

Applications

FleetPilot: Fine-Grained Steering Empowers Real-World LLM Personalization

arXiv:2610.14970v1 Announce Type: new Abstract: With the rapid evolution of large language models (LLMs), there is an increasing demand for effective personalization techniques that can adapt model be

applicationsarxiv-cs-ai

Genesis Steering: Better Activation Steering Through Training Data

arXiv:2610.19114v1 Announce Type: new Abstract: Activation steering controls large language models at inference time, but its effectiveness depends on the choice of reference data. We introduce genesi

Refine Actions If Needed: Adaptive Action Chunk Refinement for Robot Manipulation

arXiv:2610.19765v1 Announce Type: new Abstract: Computationally lightweight manipulation policies predict executable actions with low inference latency, but prediction errors can limit task success. I

safetyarxiv-cs-ro

Reliable Text-to-SQL in Resource-Constrained Settings with Small LLMs via Iterative Retry Workflows

model-releasesarxiv-cs-ai

arXiv:2610.17305v1 Announce Type: new Abstract: Large Language Models (LLMs) have recently improved Text-to-SQL generation, but their computational cost can hinder deployment in resource-constrained s

Spectral-MoE: Heterogeneous Per-Layer Expert Utilization in Dense-to-MoE Conversion

arXiv:2610.19232v1 Announce Type: new Abstract: Large language models impose substantial memory demands and arithmetic costs during inference. Dense-to-mixture-of-experts (MoE) conversion is a model o

STP-GUI: Spatially-Aware Token Pruning for Efficient Web-GUI Agents

arXiv:2610.20390v1 Announce Type: new Abstract: With the rapid development of vision-language models (VLMs), Web-GUI agents have achieved promising performance in interacting with real-world interface

local-aiarxiv-cs-cv

Adaptive-Depth Is a Finishing Stage

arXiv:2610.14252v1 Announce Type: new Abstract: Looped transformers reuse the same layer multiple times, allowing inference compute to be adjusted without changing the model. Recent adaptive-depth met

Dynamic Interpolation for Training-Time Prediction Reshaping in Low-Light Image Enhancement

model-releasesarxiv-cs-cv

arXiv:2610.18018v1 Announce Type: new Abstract: Low-light image enhancement (LLIE) is an important image/video processing problem for reliable visual systems under poor illumination, yet it remains ch

Elephant in the Fridge: Constant-Memory Frame Packing for Long Video Understanding

model-releasesarxiv-cs-cv

arXiv:2610.16118v1 Announce Type: new Abstract: Hour-long videos, streaming feeds, and movie-length content are pushing vision-language models (VLMs) past their breaking point -- the standard recipe o

Error-Based Bidirectional Predictive Coding Enables Deep, 4-Bit Predictive Coding Networks

arXiv:2610.15933v1 Announce Type: new Abstract: Predictive coding networks (PCNs) promise properties not offered by backpropagation-trained networks: learning from purely local information, a single n

local-aiarxiv-cs-lg

Fast Quantized Johnson-Lindenstrauss Transforms

arXiv:2610.16289v1 Announce Type: new Abstract: Quantization has emerged as one of the primary techniques for reducing the memory footprint of large language models during inference. A prominent examp

Joint Neural Posterior Estimation and Model Selection for Chemical Reaction Networks

arXiv:2610.18825v1 Announce Type: cross Abstract: Simulation-based Bayesian inference for Chemical Reaction Networks (CRNs) must simultaneously solve two computationally demanding problems: discrimina

Linear-Time Non-Local Codec Placement for Machine Learning Model Compression

arXiv:2610.14703v1 Announce Type: new Abstract: On-device inference imposes constraints on model storage and operand traffic and thus benefits from compressed operand representations, which mandate th

local-aiarxiv-cs-lg

MARS: Systematic Multi-Level Acceleration for World Action Models

arXiv:2610.17141v1 Announce Type: new Abstract: World Action Models (WAMs) have emerged as a promising alternative for embodied intelligence by jointly predicting future world states and robot actions

safetyarxiv-cs-cv

MERIT: Scaling KG Foundation Models with Relation Transformers

arXiv:2610.15638v1 Announce Type: new Abstract: Knowledge graph (KG) foundation models (KGFMs) predict links on unseen graphs zero-shot. KGFMs have been pioneered by ULTRA which builds a relation grap

MultiAlloc: Budget-Aware Precision Allocation for KV Cache Quantization

arXiv:2610.18642v1 Announce Type: new Abstract: The Key-Value (KV) cache constitutes a dominant source of memory consumption during large language model (LLM) inference, particularly in long-context a

One Model, Multiple Compute Budgets: Multi-Ratio ConceptMoE for Flexible Compute Across Turns

arXiv:2610.14074v1 Announce Type: new Abstract: Large language models typically support different inference budgets through separate model sizes or fixed compute configurations. In multi-turn interact

PhaseQuant: Mitigating Activation Quantization Collapse via Residual-Stream Dynamics

arXiv:2606.12487v2 Announce Type: replace Abstract: Post-training quantization (PTQ) is essential for efficient large language model (LLM) inference, but reliably quantizing activations remains challe

ShellElastic: Scalable Elastic Pretraining with Simultaneous Maximal Updates and Hyperparameter Transfer

arXiv:2610.15124v1 Announce Type: new Abstract: Foundation models need to support diverse inference budgets, yet training a separate model for each budget duplicates pretraining effort. Elastic models

TwinPrune: Density-Aware Two-Phase Token Pruning for Vision-Language Models

arXiv:2610.17530v1 Announce Type: new Abstract: We propose a unified spatial-density signal to score token importance for both inference phases: bipartite merge for prefill and KV eviction for decode,

researcharxiv-cs-cv

VideoJev: System One Model for Video Understanding and Interaction

arXiv:2610.18615v1 Announce Type: new Abstract: Visual agents must turn video observations into timely decisions to track progress and choose what to do next. Building on the emerging System One parad

researcharxiv-cs-cv

Vision-Predictor-Action: Towards Efficient Embodied AI via Neuro-Symbolic JEPA Predictors

arXiv:2610.15556v1 Announce Type: cross Abstract: Vision-Language-Action (VLA) models commonly generate robot actions token by token through Large Language Model (LLM) decoders, causing inference late

Agents

ARTIS: Agentic Risk-Aware Test-Time Scaling via Iterative Simulation

arXiv:2602.01709v3 Announce Type: replace Abstract: Current test-time scaling (TTS) techniques enhance large language model (LLM) performance by allocating additional computation at inference time, ye

agentsarxiv-cs-cl

Product Monte Carlo: Expectation Under a Product of Densities

arXiv:2610.12702v1 Announce Type: cross Abstract: Aggregating independently computed sub-sample inferences is a well-known challenge in large-scale Bayesian computation, federated learning, and opinio

Scaling RNA Foundation Models through Iterative Refinement

arXiv:2610.13106v1 Announce Type: new Abstract: Biological function in RNA is encoded across scales, from local sequence motifs to long-range structural dependencies. Conventional RNA foundation model

Hardware

STAPLE: Static Sparse Upcycling of Pretrained Checkpoints via Embedding Modules

arXiv:2610.12599v1 Announce Type: new Abstract: Sparse computation can scale the parametric capacity of LLMs without proportionally increasing active computation, but pretraining sparse architectures

hardwarearxiv-cs-lg

Two-way Guidance: Simultaneous Learning of Summary Statistics for Generative Bayes

arXiv:2610.12850v1 Announce Type: cross Abstract: Bayesian simulation-based inference (SBI) can struggle to recover increasingly concentrated posteriors as observation size grows. We consider learning

Agents

Do LLMs Learn from Rewards in Context? : Rethinking the role of reward in In-Context Reinforcement Learning

arXiv:2610.11152v1 Announce Type: cross Abstract: LLM agents increasingly improve at inference time by accumulating experience in context rather than by updating parameters. This process is often desc

agentsarxiv-cs-cl

Just Weather Scoring: Efficient End-to-end Nowcasting with Distributional Diffusion

arXiv:2610.12189v1 Announce Type: cross Abstract: Generative diffusion models are well-suited for probabilistic precipitation nowcasting, but existing approaches often rely on separately trained compr

researcharxiv-cs-cv

LIME: Link-based User-item Interaction Modeling with Decoupled XOR Attention for Efficient Test Time Scaling

arXiv:2510.18239v4 Announce Type: replace-cross Abstract: Scaling large recommendation systems requires advancing three major frontiers: processing longer user histories, expanding candidate sets, and

Predictive Multiplicity in Cell-Fate Assignment: Label-Free Rashomon Sets and the Limits of Per-Cell Certification

arXiv:2610.11185v1 Announce Type: new Abstract: Single-cell trajectory inference maps transcriptomic measurements onto developmental continua, yet configurations that fit the data equally well can ass

SPLIT-RL: Staged Perception-Language Reasoning Training with Claim-Level Advantages

arXiv:2610.10889v1 Announce Type: new Abstract: Vision-Language (VL) reasoning requires a model to both extract relevant and accurate information from an image (visual reasoning, VR), and to infer the

safetyarxiv-cs-cv

Uncovering and Fixing Collider Bias in Bayesian PINNs

model-releasesarxiv-cs-ai

arXiv:2610.11737v1 Announce Type: cross Abstract: Bayesian physics-informed neural networks (B-PINNs) are a popular framework for parameter and state inference from sparse or noisy observations. They

Which Skill to Distill? SGUID: Selecting a Compact Skill Bank for Model-Skill Co-Evolution

model-releasesarxiv-cs-cl

arXiv:2610.12367v1 Announce Type: new Abstract: Skills, reusable procedural guidance added at inference, can substantially improve LLM downstream performance (Li et al., 2026). Prior work retrieves sk

Causal Posterior Estimation

arXiv:2505.21468v2 Announce Type: replace Abstract: We present Causal Posterior Estimation (CPE), a novel method for Bayesian inference in simulator models, where evaluating the likelihood function is

Distilling Graph Geometry: Knowledge Gap from GNNs to MLPs

arXiv:2610.10520v1 Announce Type: new Abstract: GNN-to-MLP distillation aims to retain the predictive accuracy of a message-passing teacher while deploying a graph-free MLP at inference. Existing meth

safetyarxiv-cs-lg

From Pareto to Preference: Personalized Test-Time Scaling via Amortized Agentic Policy Discovery

arXiv:2610.09684v1 Announce Type: new Abstract: Test-time scaling (TTS) improves the reasoning capabilities of large language models by allocating additional inference computation. Existing approaches

safetyarxiv-cs-cl

RFPO: Rectified Flow Policy Optimization for Embodied Control

arXiv:2610.10453v1 Announce Type: new Abstract: Flow-based policies provide an expressive framework for continuous robot control, but their iterative ODE integration incurs substantial inference cost.

safetyarxiv-cs-ro

Same Text, Different Prediction: Serving-Context Nondeterminism in Text Classifiers

arXiv:2610.09111v1 Announce Type: new Abstract: Deterministic inference is essential for reliable and trustworthy machine learning. Prior studies of text generation have shown that changing factors su

researcharxiv-cs-cl

SpikingVLA: Asynchronous Spiking Vision-Language-Action Models

arXiv:2610.09710v1 Announce Type: new Abstract: ANN-to-SNN conversion offers a practical route toward energy-efficient spiking Vision-Language-Action (VLA) models by bypassing the substantial cost of

researcharxiv-cs-cl

Steerspeech: Activation Steering For Emotion Control In Generated Speech

arXiv:2610.10415v1 Announce Type: cross Abstract: Pretrained text-to-speech (TTS) models can generate expressive speech, but reliable inference-time emotion control remains challenging: prompts and re

TAP: Efficient Long-Horizon Agent Pruning via Trajectory-Anchored Recovery

arXiv:2610.09074v1 Announce Type: new Abstract: Emerging long-horizon agentic tasks require repeated model calls, worsening the inference cost of already-costly language models. While narrow agentic t

safetyarxiv-cs-lg

Secure Speculative Decoding for Large Language Models

arXiv:2610.08678v1 Announce Type: cross Abstract: Speculative decoding accelerates inference for a large language model (LLM), referred to as the target model, by first using a smaller model, referred

safetyarxiv-cs-ai

7 Oct 2026

Steering Diffusion Models to Rare Events with Sequential Monte Carlo

arXiv:2610.08652v1 Announce Type: cross Abstract: Diffusion models are increasingly used as surrogates for expensive simulators in weather prediction, molecular dynamics, and materials design. In thes

7 Oct 2026

A Geometric-Transformation Feature-Adaptive Manifold Restoration Method for Open-Vocabulary Semantic Segmentation of Remote Sensing Images

arXiv:2610.04300v1 Announce Type: new Abstract: The semantic information of objects in remote sensing images is typically invariant to geometric transformations from the dihedral group D4. However, SA

local-aiarxiv-cs-cv

6 Oct 2026

Beyond LLM Serving: Characterizing Vision-Language-Action Workloads for Embodied AI System Design