Search: “inference”

Geometry-Aware Discretization Error of Diffusion Models

arXiv:2605.08392v1 Announce Type: new Abstract: Practical diffusion sampling is a numerical approximation problem: under a fixed inference budget, one must simulate a reverse-time ODE or SDE using onl

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

GLiNER-Relex: A Unified Framework for Joint Named Entity Recognition and Relation Extraction

DGX agent

arXiv:2605.10108v1 Announce Type: new Abstract: Joint named entity recognition (NER) and relation extraction (RE) is a fundamental task in natural language processing for constructing knowledge graphs

model-releasesarxiv-cs-cl

12 May 2026

GravityGraphSAGE: Link Prediction in Directed Attributed Graphs

arXiv:2605.09408v1 Announce Type: new Abstract: Link prediction (inferring missing or future connections between nodes in a graph) is a fundamental problem in network science with widespread applicati

GRC: Unifying Reasoning-Driven Generation, Retrieval and Compression

arXiv:2605.09100v1 Announce Type: new Abstract: Text embedding and generative tasks are usually trained separately based on large language models (LLMs) nowadays. This causes a large amount of trainin

agentsarxiv-cs-cl

Inpainting physics: self-supervised learning for context-driven fluid simulation

arXiv:2605.08832v1 Announce Type: new Abstract: Neural surrogate models for computational fluid dynamics (CFD) are typically trained as forward operators that map explicit problem specifications, such

local-aiarxiv-cs-lg

KEPIL: Knowledge-Enhanced Prompt-Image Learning for Prompt-Robust Disease Detection

model-releasesarxiv-cs-cv

arXiv:2605.09132v1 Announce Type: new Abstract: Vision--language models (VLMs) show promise for clinical decision support in radiology because they enable joint reasoning over radiological images and

Nix and Fix: Targeting 1000x Compression of 3D Gaussian Splatting with Diffusion Models

arXiv:2602.04549v2 Announce Type: replace Abstract: 3D Gaussian Splatting (3DGS) revolutionized novel view rendering. Instead of inferring from dense spatial points, as implicit representations do, 3D

researcharxiv-cs-cv

No Mean Feat: Simple, Strong Baselines for Context Compression

arXiv:2510.20797v2 Announce Type: replace-cross Abstract: Context compression reduces Transformer inference costs by replacing lengthy inputs with shorter pre-computed representations. It carries sign

On Variance Reduction in Learning Mean Flows

arXiv:2605.09235v1 Announce Type: cross Abstract: One-step generative modeling has emerged as a leading approach to amortize the inference cost of diffusion and flow-matching models. Among distillatio

safetyarxiv-cs-ai

Tutorials

Predicting 3D structure by latent posterior sampling

arXiv:2605.10830v1 Announce Type: new Abstract: The remarkable achievements of both generative models of 2D images and neural field representations for 3D scenes present a compelling opportunity to in

tutorialsarxiv-cs-cv

Prompt-Activation Duality: Improving Activation Steering via Attention-Level Interventions

model-releasesarxiv-cs-ai

arXiv:2605.10664v1 Announce Type: cross Abstract: Activation steering controls language model behavior by adding directions to internal representations at inference time, but standard residual-stream

ReST-KV: Robust KV Cache Eviction with Layer-wise Output Reconstruction and Spatial-Temporal Smoothing

arXiv:2605.08840v1 Announce Type: new Abstract: Large language models (LLMs) face growing challenges in efficient generative inference due to the increasing memory demands of Key-Value (KV) caches, es

researcharxiv-cs-cl

SlimSpec: Low-Rank Draft LM-Head for Accelerated Speculative Decoding

arXiv:2605.10453v1 Announce Type: cross Abstract: Speculative decoding speeds up autoregressive generation in Large Language Models (LLMs) through a two-step procedure, where a lightweight draft model

researcharxiv-cs-cl

Stellar Age Compression Reshapes Interpretations of the Milky Way Thick-Disk Formation History

arXiv:2605.10220v1 Announce Type: cross Abstract: The formation timescale of the Milky Way thick disk is one of the central debates in Galactic archaeology. The age-metallicity relation (AMR), formati

Tutorials

Teaching Molecular Dynamics to a Non-Autoregressive Ionic Transport Predictor

arXiv:2605.09311v1 Announce Type: cross Abstract: Unlike most static material properties widely studied in the machine learning literature, ionic transport properties are inherently dynamic, making th

tutorialsarxiv-cs-ai

Tight Generalization Bounds for Noiseless Inverse Optimization

arXiv:2605.08866v1 Announce Type: cross Abstract: Inverse optimization (IO) seeks to infer the parameters of a decision-maker's objective from observed context--action data. We study noiseless IO, whe

TileQ: Efficient Low-Rank Quantization of Mixture-of-Experts with 2D Tiling

arXiv:2605.09281v1 Announce Type: new Abstract: Mixture-of-Experts (MoE) models achieve remarkable performance by sparsely activating specialized experts, yet their massive parameters in experts pose

TMAS: Scaling Test-Time Compute via Multi-Agent Synergy

arXiv:2605.10344v1 Announce Type: new Abstract: Test-time scaling has become an effective paradigm for improving the reasoning ability of large language models by allocating additional computation dur

agentsarxiv-cs-ai

Uniform Inductive Spatio-Temporal Kriging

arXiv:2603.05301v2 Announce Type: replace Abstract: Inductive spatio-temporal kriging infers signals at unobserved locations from observed sensors, but real-world observations are often incomplete and

safetyarxiv-cs-ai

VECTOR-Drive: Tightly Coupled Vision-Language and Trajectory Expert Routing for End-to-End Autonomous Driving

arXiv:2605.08830v1 Announce Type: cross Abstract: End-to-end autonomous driving requires models to understand traffic scenes, infer driving intent, and generate executable motion plans. Recent vision-

agentsarxiv-cs-ai

Hardware

We published new research on how we serve post-trained Qwen3 235B models on NVIDIA GB200 NVL72 Blackwell racks. GB200 is a major step up ove…

We published new research on how we serve post-trained Qwen3 235B models on NVIDIA GB200 NVL72 Blackwell racks. GB200 is a major step up over Hopper for high-throughput inference on large MoE models,

hardwareperplexity--x

When Does Value-Aware KV Eviction Help? A Fixed-Contract Diagnostic for Non-Monotone Cache Compression

arXiv:2605.08234v1 Announce Type: cross Abstract: Long-context LLM inference is bottlenecked by the memory and bandwidth cost of reading large KV caches during decoding. KV compression reduces this co

@xai strategy analysis of @openai, @anthropicai, and @xai based on open roles

This post analyzes the strategic directions and priorities of OpenAI, Anthropic, and xAI by examining their publicly listed job openings, inferring each company's focus areas, capabilities development

agentsyohei-nakajima--x

AMD and Red Hat target enterprise AI costs with broader compute choice

Enterprise AI adoption has crossed a threshold: The question is no longer whether to invest, but how to do it wisely. As agentic workloads multiply and inference costs rise, AI choice — the ability to

agentssiliconangle

Attention Sparsity is Input-Stable: Training-Free Sparse Attention for Video Generation via Offline Sparsity Profiling and Online QK Co-Clustering

arXiv:2603.18636v2 Announce Type: replace Abstract: Diffusion Transformers (DiTs) achieve strong video generation quality but suffer from high inference cost due to dense 3D attention, motivating spar

researcharxiv-cs-cv

b9102: [SYCL] Add OP im2col_3d (#22903)

Release b9102 adds support for the im2col_3d operator to the SYCL backend in llama.cpp, expanding GPU-accelerated tensor operations for Intel GPU inference. The im2col_3d operation converts 3D input v

b9103

B9103 is a recent release of llama.cpp , a C/C++ implementation for large language model inference. This release represents one of the latest versions in the project's active development cycle, buildi

Convergence and Emergence of In-Context Reinforcement Learning with Chain of Thought

arXiv:2605.07123v1 Announce Type: new Abstract: In-context reinforcement learning (ICRL) refers to the ability of RL agents to adapt to new tasks at inference time without parameter updates by conditi

Distributional Process Reward Models: Calibrated Prediction of Future Rewards via Conditional Optimal Transport

arXiv:2605.06785v1 Announce Type: cross Abstract: Inference-time scaling methods rely on Process Reward Models (PRMs), which are often poorly calibrated and overestimate success probabilities. We prop

Generalised Linear Models in Deep Bayesian RL with Learnable Basis Functions

arXiv:2512.20974v3 Announce Type: replace-cross Abstract: Bayesian Reinforcement Learning (BRL), a subclass of Meta-Reinforcement Learning (Meta-RL), provides a principled framework for generalisation

safetyarxiv-cs-ai

Inverse Reinforcement Learning with Just Classification and a Few Regressions

arXiv:2509.21172v2 Announce Type: replace Abstract: Inverse reinforcement learning (IRL) aims to infer rewards from observed behavior, but rewards are not identified from the policy alone: many reward

safetyarxiv-cs-lg

Koopman Autoencoders with Continuous-Time Latent Dynamics for Fluid Dynamics Forecasting

arXiv:2602.02832v3 Announce Type: replace Abstract: Forecasting physical systems over long horizons from irregularly sampled observations demands models that are stable, computationally efficient, and

LaTER: Efficient Test-Time Reasoning via Latent Exploration and Explicit Verification

arXiv:2605.07315v1 Announce Type: new Abstract: Chain-of-thought (CoT) reasoning improves large language models (LLMs) on difficult tasks, but it also makes inference expensive because every intermedi

researcharxiv-cs-cl

Tutorials

LKV: End-to-End Learning of Head-wise Budgets and Token Selection for LLM KV Cache Eviction

arXiv:2605.06676v1 Announce Type: cross Abstract: Long-context inference in Large Language Models (LLMs) is bottlenecked by the linear growth of Key-Value (KV) cache memory. Existing KV cache compress

tutorialsarxiv-cs-cl

On the Role of Strain and Vorticity in Numerical Integration Error for Flow Matching

arXiv:2605.06680v1 Announce Type: cross Abstract: Flow matching generates data by integrating a learned velocity field, where the number of integration steps (NFE) directly determines inference cost.

researcharxiv-cs-cv

R^3L: Reasoning 3D Layouts from Relative Spatial Relations

arXiv:2605.06758v1 Announce Type: cross Abstract: Relative spatial relations provide a compact representation of spatial structure and are fundamental to relative spatial reasoning in 3D layout genera

Skip-It? Theoretical Conditions for Layer Skipping in Vision-Language Models

arXiv:2509.25584v2 Announce Type: replace Abstract: Vision-language models achieve incredible performance across a wide range of tasks, but their large size makes inference costly. Recent work has sho

Hardware

SpikingBrain: Spiking Brain-inspired Large Models

arXiv:2509.05276v4 Announce Type: replace-cross Abstract: Mainstream Transformer-based large language models face major efficiency bottlenecks: training computation scales quadratically with sequence

hardwarearxiv-cs-ai

STEPS: A Temporal Smooth Error Propagation Solver on the Manifolds for Test-Time Adaptation in Time Series Forecasting

arXiv:2605.08005v1 Announce Type: new Abstract: Test-Time Adaptation (TTA) aims to improve time series forecasting under distribution shifts by using limited observations revealed during inference. Ho

Transformer-Based Wildlife Species Classification from Daily Movement Trajectories

arXiv:2605.06726v1 Announce Type: new Abstract: Inferring the identity of wildlife species from daily movement data alone is a challenging task. We train sequence models on large-scale, 7-species GPS

TTF: Temporal Token Fusion for Efficient Video-Language Model

arXiv:2605.07355v1 Announce Type: cross Abstract: Video-language models (VLMs) face rapid inference costs as visual token counts scale with video length. For example, 32 frames at 448{imes}448 resolut

VecCISC: Improving Confidence-Informed Self-Consistency with Reasoning Trace Clustering and Candidate Answer Selection

arXiv:2605.08070v1 Announce Type: new Abstract: A standard technique for scaling inference-time reasoning is Self-Consistency, whereby multiple candidate answers are sampled from an LLM and the most c

b9094

Release b9094 is a commit/version of llama.cpp, the main playground for developing features for the GGML library. llama.cpp enables LLM inference in C/C++ , providing efficient tools for running large

10 May 2026

b9095

b9095 is a release of llama.cpp, a project focused on LLM inference in C/C++ . This release likely includes updates, bug fixes, or feature improvements to the llama.cpp codebase, which enables efficie

10 May 2026

b9101

Build b9101 of llama.cpp includes improvements to the AllReduce functionality for tensor-parallel GPU inference, introducing a NCCL-free implementation using CUDA kernels for cross-GPU communication.

10 May 2026

b9087

The search results don't contain specific information about release b9087. Based on the context, b9087 is a release from llama.cpp, a C/C++ implementation for LLM inference . This release likely conta

9 May 2026

b9073

b9073 is a release of llama.cpp, a C/C++ implementation for LLM inference . The release likely contains bug fixes, performance improvements, or new features for the llama.cpp project, which provides o

8 May 2026

b9077

B9077 is a release of llama.cpp, a C/C++ library for LLM inference. The llama.cpp project follows a rapid release cycle with multiple releases published in a single day. This build version represents