Search: “inference”

Koopman Autoencoders with Continuous-Time Latent Dynamics for Fluid Dynamics Forecasting

arXiv:2602.02832v3 Announce Type: replace Abstract: Forecasting physical systems over long horizons from irregularly sampled observations demands models that are stable, computationally efficient, and

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Research

LaTER: Efficient Test-Time Reasoning via Latent Exploration and Explicit Verification

DGX agent

arXiv:2605.07315v1 Announce Type: new Abstract: Chain-of-thought (CoT) reasoning improves large language models (LLMs) on difficult tasks, but it also makes inference expensive because every intermedi

researcharxiv-cs-cl

11 May 2026

Tutorials

LKV: End-to-End Learning of Head-wise Budgets and Token Selection for LLM KV Cache Eviction

arXiv:2605.06676v1 Announce Type: cross Abstract: Long-context inference in Large Language Models (LLMs) is bottlenecked by the linear growth of Key-Value (KV) cache memory. Existing KV cache compress

tutorialsarxiv-cs-cl

On the Role of Strain and Vorticity in Numerical Integration Error for Flow Matching

arXiv:2605.06680v1 Announce Type: cross Abstract: Flow matching generates data by integrating a learned velocity field, where the number of integration steps (NFE) directly determines inference cost.

R^3L: Reasoning 3D Layouts from Relative Spatial Relations

arXiv:2605.06758v1 Announce Type: cross Abstract: Relative spatial relations provide a compact representation of spatial structure and are fundamental to relative spatial reasoning in 3D layout genera

Skip-It? Theoretical Conditions for Layer Skipping in Vision-Language Models

arXiv:2509.25584v2 Announce Type: replace Abstract: Vision-language models achieve incredible performance across a wide range of tasks, but their large size makes inference costly. Recent work has sho

Hardware

SpikingBrain: Spiking Brain-inspired Large Models

arXiv:2509.05276v4 Announce Type: replace-cross Abstract: Mainstream Transformer-based large language models face major efficiency bottlenecks: training computation scales quadratically with sequence

hardwarearxiv-cs-ai

STEPS: A Temporal Smooth Error Propagation Solver on the Manifolds for Test-Time Adaptation in Time Series Forecasting

arXiv:2605.08005v1 Announce Type: new Abstract: Test-Time Adaptation (TTA) aims to improve time series forecasting under distribution shifts by using limited observations revealed during inference. Ho

Transformer-Based Wildlife Species Classification from Daily Movement Trajectories

arXiv:2605.06726v1 Announce Type: new Abstract: Inferring the identity of wildlife species from daily movement data alone is a challenging task. We train sequence models on large-scale, 7-species GPS

TTF: Temporal Token Fusion for Efficient Video-Language Model

arXiv:2605.07355v1 Announce Type: cross Abstract: Video-language models (VLMs) face rapid inference costs as visual token counts scale with video length. For example, 32 frames at 448{imes}448 resolut

VecCISC: Improving Confidence-Informed Self-Consistency with Reasoning Trace Clustering and Candidate Answer Selection

arXiv:2605.08070v1 Announce Type: new Abstract: A standard technique for scaling inference-time reasoning is Self-Consistency, whereby multiple candidate answers are sampled from an LLM and the most c

Beyond Public Access in LLM Pre-Training Data

arXiv:2505.00020v2 Announce Type: replace Abstract: Using a legally obtained dataset of 34 copyrighted O'Reilly Media books, we apply the DE-COP membership inference attack method to investigate wheth

safetyarxiv-cs-cl

Conceptors for Semantic Steering

arXiv:2605.04980v1 Announce Type: cross Abstract: Activation-based steering provides control of LLM behavior at inference time, but the dominant paradigm reduces each concept to a single direction who

Distilling Bayesian Belief States into Language Models for Auditable Negotiation

arXiv:2605.04507v1 Announce Type: new Abstract: Negotiation agents must infer what their counterpart values, update those beliefs over dialogue turns, and choose actions under uncertainty. End-to-end

safetyarxiv-cs-cl

From Video-to-PDE: Data-Driven Discovery of Nonlinear Dye Plume Dynamics

arXiv:2605.04535v1 Announce Type: new Abstract: Inferring continuum models directly from video is hampered by two facts: the recorded field is uncalibrated image intensity rather than a physical state

GTF: Omnidirectional EPI Transformer for Light Field Super-Resolution

arXiv:2605.04581v1 Announce Type: new Abstract: Light field (LF) image super-resolution benefits from Epipolar Plane Images (EPIs), whose line slopes explicitly encode disparity. However, existing Tra

Joint Treatment Effect Estimation from Incomplete Healthcare Data: Temporal Causal Normalizing Flows with LLM-driven Evolutionary MNAR Imputation

arXiv:2605.05125v1 Announce Type: new Abstract: Target trial emulation (TTE) enables causal questions to be studied with observational data when randomized controlled trials (RCTs) are infeasible. Yet

Learning Time-Varying Graphs from Incomplete Graph Signals

arXiv:2510.17903v3 Announce Type: replace-cross Abstract: This paper tackles the challenging problem of jointly inferring time-varying network topologies and imputing missing data from partially obser

MoLF: Mixture-of-Latent-Flow for Pan-Cancer Spatial Gene Expression Prediction from Histology

arXiv:2602.02282v2 Announce Type: replace Abstract: Inferring spatial transcriptomics (ST) from histology enables scalable histogenomic profiling, yet current methods are largely restricted to single-

One Pool, Two Caches: Adaptive HBM Partitioning for Accelerating Generative Recommender Serving

arXiv:2605.04450v1 Announce Type: cross Abstract: Generative Recommender (GR) inference places embedding hot caches (EMB) and KV caches in direct competition for limited GPU HBM: allocating more memor

safetyarxiv-cs-lg

UAV-VL-R1: Generalizing Vision-Language Models via Supervised Fine-Tuning and Multi-Stage GRPO for UAV Visual Reasoning

arXiv:2508.11196v2 Announce Type: replace Abstract: Recent advances in vision-language models (VLMs) have demonstrated strong generalization in natural image tasks. However, their performance often de

safetyarxiv-cs-cv

Understanding LoRA as Knowledge Memory: An Empirical Analysis

arXiv:2603.01097v2 Announce Type: replace Abstract: Continuous knowledge updating for pre-trained large language models (LLMs) is increasingly necessary yet remains challenging. Although inference-tim

Applications

When LLMs get significantly worse: A statistical approach to detect model degradations

arXiv:2602.10144v2 Announce Type: replace-cross Abstract: Minimizing the inference cost and latency of foundation models has become a crucial area of research. Optimization approaches include theoreti

applicationsarxiv-cs-lg

Distilling Long-CoT Reasoning through Collaborative Step-wise Multi-Teacher Decoding

arXiv:2605.02290v1 Announce Type: new Abstract: Distilling large reasoning models is essential for making Long-CoT reasoning practical, as full-scale inference remains computationally prohibitive. Exi

Do Not Waste Your Rollouts: Recycling Search Experience for Efficient Test-Time Scaling

arXiv:2601.21684v2 Announce Type: replace Abstract: Test-Time Scaling enhances the reasoning capabilities of Large Language Models by allocating additional inference compute to broaden the exploration

Efficient Deconvolution in Populational Inverse Problems

arXiv:2505.19841v2 Announce Type: replace-cross Abstract: This work is focussed on the inversion task of inferring the distribution over parameters of interest leading to multiple sets of observations

Hybrid Models for Natural Language Reasoning: The Case of Syllogistic Logic

arXiv:2510.09472v2 Announce Type: replace Abstract: Despite the remarkable progress in neural models, their ability to generalize, a cornerstone for applications such as logical reasoning, remains a c

InvisibleInk: High-Utility and Low-Cost Text Generation with Differential Privacy

arXiv:2507.02974v3 Announce Type: replace-cross Abstract: As major progress in LLM-based long-form text generation enables paradigms such as retrieval-augmented generation (RAG) and inference-time sca

Prism: Efficient Test-Time Scaling via Hierarchical Search and Self-Verification for Discrete Diffusion Language Models

arXiv:2602.01842v3 Announce Type: replace Abstract: Inference-time compute has re-emerged as a practical way to improve LLM reasoning. Most test-time scaling (TTS) algorithms rely on autoregressive de

Reasoning Models Can be Accurately Pruned Via Chain-of-Thought Reconstruction

model-releasesarxiv-cs-ai

arXiv:2509.12464v2 Announce Type: replace Abstract: Reasoning language models such as DeepSeek-R1 produce long chain-of-thought traces during inference time which make them costly to deploy at scale.

Steer Like the LLM: Activation Steering that Mimics Prompting

arXiv:2605.03907v1 Announce Type: new Abstract: Large language models can be steered at inference time through prompting or activation interventions, but activation steering methods often underperform

Where Paths Split: Localized, Calibrated Control of Moral Reasoning in Large Language Models

arXiv:2605.03609v1 Announce Type: cross Abstract: Large language models often display heterogeneous moral preferences across settings. We study inference-time steering toward a desired ethical framewo

Component-Aware Self-Speculative Decoding in Hybrid Language Models

arXiv:2605.01106v1 Announce Type: new Abstract: Speculative decoding accelerates autoregressive inference by drafting candidate tokens with a fast model and verifying them in parallel with the target.

FT-RAG: A Fine-grained Retrieval-Augmented Generation Framework for Complex Table Reasoning

arXiv:2605.01495v1 Announce Type: new Abstract: Retrieval-Augmented Generation (RAG) enhances Large Language Models (LLMs) by grounding responses in external knowledge during inference. However, conve

Know Yourself Better: Diverse Object-Related Features Improve Open Set Recognition

arXiv:2404.10370v3 Announce Type: replace Abstract: Open set recognition (OSR) is a critical aspect of machine learning, addressing the challenge of detecting novel classes during inference. Within th

MooD: An Efficient VA-Driven Affective Image Editing Framework via Fine-Grained Semantic Control

arXiv:2605.02521v1 Announce Type: new Abstract: Affective image editing (AIE) aims to edit visual content to evoke target emotions. However, existing methods often overlook inference efficiency and pr

Pi-Change: A Prior-Informed Multiple Change Point Detection Algorithm

arXiv:2605.01003v1 Announce Type: cross Abstract: Statistical change point (CP) detection methods typically rely on likelihood-based inference and ignore contextual information about plausible CP loca

SpecKV: Adaptive Speculative Decoding with Compression-Aware Gamma Selection

arXiv:2605.02888v1 Announce Type: cross Abstract: Speculative decoding accelerates large language model (LLM) inference by using a small draft model to propose candidate tokens that a larger target mo

The Multi-View Paradigm Shift in MRI Radiomics: Predicting MGMT Methylation in Glioblastoma

arXiv:2512.22331v2 Announce Type: replace Abstract: Non-invasive inference of molecular tumor characteristics from medical imaging is a central goal of radiogenomics, particularly in glioblastoma (GBM

When RL Meets Adaptive Speculative Training: A Unified Training-Serving System

arXiv:2602.06932v3 Announce Type: replace Abstract: Speculative decoding can significantly accelerate LLM serving, yet most deployments today disentangle speculator training from serving, treating spe

Applications

Being-H0.7: A Latent World-Action Model from Egocentric Videos

arXiv:2605.00078v1 Announce Type: cross Abstract: Visual-Language-Action models (VLAs) have advanced generalist robot control by mapping multimodal observations and language instructions directly to a

applicationsarxiv-cs-cv

Tutorials

Doubly robust identification of treatment effects from multiple environments

arXiv:2503.14459v2 Announce Type: replace-cross Abstract: Practical and ethical constraints often require the use of observational data for causal inference, particularly in medicine and social scienc

tutorialsarxiv-cs-lg

GD4: Graph-based Discrete Denoising Diffusion for MIMO Detection

arXiv:2605.00423v1 Announce Type: new Abstract: In wireless communications, recovering the optimal solution to the multiple-input multiple-output (MIMO) detection problem is NP-hard. Obtaining high-qu

Make Your LVLM KV Cache More Lightweight

model-releasesarxiv-cs-cv

arXiv:2605.00789v1 Announce Type: new Abstract: Key-Value (KV) cache has become a de facto component of modern Large Vision-Language Models (LVLMs) for inference. While it enhances decoding efficiency

PhysEdit: Physically-Consistent Region-Aware Image Editing via Adaptive Spatio-Temporal Reasoning

arXiv:2605.00707v1 Announce Type: new Abstract: Image editing instructions are heterogeneous: a color swap, an object insertion, and a physical-action edit all demand different spatial coverage and di

Real-Time Frame- and Event-based Object Detection with Spiking Neural Networks on Edge Neuromorphic Hardware: Design, Deployment and Benchmark

model-releasesarxiv-cs-cv

arXiv:2605.00146v1 Announce Type: new Abstract: Real-time object detection on energy-constrained platforms is critical for applications such as UAV-based inspection, autonomous navigation, and mobile

Structure Liberates: How Constrained Sensemaking Produces More Novel Research Output

arXiv:2605.00557v1 Announce Type: new Abstract: Scientific discovery is an extended process of ideation--surveying prior work, forming hypotheses, and refining reasoning--yet existing approaches treat

Hardware

Benchmarking Deep Learning Models for Object Detection on Edge Computing Devices