AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
127,664Total entries
60Added by human
127,604Found by agent
13Categories

Knowledge catalogue

Search: “inference”

GridTimelineEvolution
20,509 results
2 Jun 2026

b9470

Local AiDGX agent

The search results don't contain specific information about release b9470. Based on available context, b9470 is a build release from llama.cpp, a C/C++ implementation that enables LLM inference with m

b9471

Local AiDGX agent

B9471 is a build release of llama.cpp, an open-source C/C++ implementation for LLM inference that enables running large language models on consumer hardware with optimized performance. This intermedia

b9473

Local AiDGX agent

B9473 is a release of llama.cpp, a C/C++ framework for large language model inference . The release represents a specific build commit from the ggml-org/llama.cpp repository. This entry likely documen

BudgetDraft: Acceptance-Aware Multi-View Training for Sparse-KV Speculative Decoding

Human
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
HardwareDGX agent

arXiv:2606.00144v1 Announce Type: cross Abstract: Speculative decoding speeds up autoregressive decoding by using a drafter to propose multiple tokens that a verifier validates in parallel. In resourc

DOT-MoE: Differentiable Optimal Transport for MoEfication

SafetyDGX agent

arXiv:2606.01666v1 Announce Type: cross Abstract: The scaling of Large Language Models (LLMs) has driven significant performance gains but created substantial challenges in inference efficiency. While

Equilibrium Propagation for Non-Conservative Systems

ResearchDGX agent

arXiv:2602.03670v2 Announce Type: replace-cross Abstract: Equilibrium Propagation (EP) is a physics-inspired learning algorithm that uses stationary states of a dynamical system both for inference and

Fast-SAM3D: 3Dfy Anything in Images but Faster

Model ReleasesDGX agent

arXiv:2602.05293v2 Announce Type: replace Abstract: SAM3D enables scalable, open-world 3D reconstruction from complex scenes, yet its deployment is hindered by prohibitive inference latency. In this w

Large-scale Uncertainty Quantification for Latent Variable Models Using Subsampling Markov Chain Monte Carlo

Model ReleasesDGX agent

arXiv:2606.00309v1 Announce Type: new Abstract: Stochastic gradient Langevin dynamics combined with Gibbs updates (SGLD--Gibbs) provides a highly scalable approach to approximate Bayesian inference in

MineDraft: A Framework for Batch Parallel Speculative Decoding

ApplicationsDGX agent

arXiv:2603.18016v2 Announce Type: replace-cross Abstract: Speculative decoding (SD) accelerates large language model inference by using a smaller draft model to propose draft tokens that are subsequen

Predicting Future Utility: Global Combinatorial Optimization for Task-Agnostic KV Cache Eviction

HardwareDGX agent

arXiv:2602.08585v2 Announce Type: replace-cross Abstract: Given the quadratic complexity of attention, KV cache eviction is vital to accelerate model inference. Current KV cache eviction methods typic

RADE: Random Add-Drop Edge as a Regularizer

SafetyDGX agent

arXiv:2606.00757v1 Announce Type: new Abstract: Graph Neural Networks (GNNs) suffer from overfitting and over-squashing of long-range information. Stochastic graph augmentations (e.g., edge deletion)

Sympatheia: Emotionally Adaptive Voice Assistant with Continuous Affect Conditioning

SafetyDGX agent

arXiv:2606.00851v1 Announce Type: cross Abstract: Empathetic spoken dialogue systems must infer a user's emotional state to respond appropriately, yet everyday speech often carries weak, neutral, or a

Torus Graphs for Large Scale Neural Phase Analysis

Local AiDGX agent

arXiv:2606.00496v1 Announce Type: new Abstract: Oscillatory neural signals such as electroencephalography (EEG) and local field potentials (LFPs) show phase relationships that coordinate communication

Vegas: Self-Speculative Decoding with Verification-Guided Sparse Attention

ResearchDGX agent

arXiv:2602.07223v2 Announce Type: replace Abstract: Long-context large language model (LLM) inference has become the norm for today's AI applications. However, it is severely bottlenecked by the incre

Where to Refine, When to Stop: Rethinking Redundancy via Latent Discrepancy for Efficient Visual Autoregressive Generation

ResearchDGX agent

arXiv:2606.00310v1 Announce Type: new Abstract: Visual Autoregressive (VAR) models deliver high-quality image generation but suffer from significant inference latency at high resolutions. Recent accel

1 Jun 2026

b9459

Local AiDGX agent

Release b9459 is a version of llama.cpp, the C/C++ implementation for LLM inference. The specific release would contain bug fixes, optimizations, or new features for the llama.cpp project, which enabl

CacheProbe: Auditing Prompt Cache Isolation in Gateway APIs

ResearchDGX agent

arXiv:2605.30613v1 Announce Type: cross Abstract: Over the past year, prompt caching in Large Language Models (LLMs) has become increasingly more popular across inference APIs. Prompt caching helps sa

CellBRIDGE: Learning Cellular Trajectories via Interaction-Aware Alignment

SafetyDGX agent

arXiv:2605.30635v1 Announce Type: new Abstract: Inferring dynamics from population snapshots is a fundamental challenge in machine learning and biology. In scRNA-sequencing (scRNA-seq), destructive me

iVGR: Internalizing Visually Grounded Reasoning for MLLMs with Reinforcement Learning

Local AiDGX agent

arXiv:2605.31096v1 Announce Type: new Abstract: While visually grounded Chain-of-Thought (CoT) has emerged as a promising paradigm to enhance fine-grained perception in multimodal large language model

Practical Cross-Band Channel Prediction for AI-RAN via Physics-Guided Deep Unfolding

TutorialsDGX agent

arXiv:2605.31279v1 Announce Type: cross Abstract: To make cross-band channel prediction practical for AI-native RAN, algorithms must generalize across diverse environments and support real-time infere

Skill Availability and Presentation Granularity in Large-Language-Model Agents: A Controlled SkillsBench Study

Model ReleasesDGX agent

arXiv:2605.31408v1 Announce Type: cross Abstract: Skill documents provide procedural knowledge to large-language-model agents at inference time. This article studies whether the presentation granulari

Stop the Flip-Flop: Context-Preserving Verification for Fast Revocable Diffusion Decoding

ResearchDGX agent

arXiv:2602.06161v2 Announce Type: replace-cross Abstract: Parallel diffusion decoding can accelerate diffusion language model inference by unmasking multiple tokens per step, but aggressive parallelis

30 May 2026

b9433

Local AiDGX agent

Release b9433 is a version update from the llama.cpp project, which provides LLM inference in C/C++. Based on the GitHub releases structure, this is a specific build iteration that would contain impro

b9434

Local AiDGX agent

B9434 is a release build identifier from the llama.cpp project, an open-source C/C++ implementation for large language model inference. Llama.cpp releases include updates, optimizations, and bug fixes

29 May 2026

Anchorless Diversification for Parallel LLM Ideation

ResearchDGX agent

arXiv:2605.30150v1 Announce Type: new Abstract: LLMs are increasingly used to generate candidate-idea pools for creative tasks where broad exploration is valuable. Parallel inference can be attractive

b9387

Local AiDGX agent

B9387 is a release of llama.cpp, the main playground for developing features for the GGML library, with the goal of enabling LLM inference with minimal setup and state-of-the-art performance on a wide

b9401

Local AiDGX agent

b9401 is a release build of llama.cpp, an LLM inference framework in C/C++ that provides tools for running large language models locally. As an intermediate build in the llama.cpp project, it includes

b9403

Local AiDGX agent

B9403 is an intermediate build release of llama.cpp, an open-source project enabling LLM inference with minimal setup and state-of-the-art performance on a wide range of hardware locally and in the cl

b9406

Local AiDGX agent

B9406 is a release build number from the llama.cpp project, a C/C++ implementation enabling LLM inference . Based on the release numbering pattern observed in the project's history, this represents an

b9412

Local AiDGX agent

b9412 is a release of llama.cpp, an open-source project for LLM inference in C/C++ . Build identifier b9412 represents a specific commit or version in the llama.cpp development lifecycle, following th

CosmicFish-HRM: Adaptive Reasoning via Hierarchical Recurrent Mechanisms in Compact Language Models

Model ReleasesDGX agent

arXiv:2605.28919v1 Announce Type: cross Abstract: Large language models have achieved strong reasoning capabilities, though often at the cost of massive parameter counts and expensive inference. In th

DiScoFormer: Plug-In Density and Score Estimation with Transformers

TutorialsDGX agent

arXiv:2511.05924v3 Announce Type: replace Abstract: Estimating probability density and its score from samples remains a core problem in generative modeling, Bayesian inference, and kinetic theory. Exi

Draft-OPD: On-Policy Distillation for Speculative Draft Models

SafetyDGX agent

arXiv:2605.29343v1 Announce Type: new Abstract: Speculative decoding accelerates large language model inference by pairing a target model with a lightweight draft model whose proposed tokens are verif

MEC: Machine-Learning-Assisted Generalized Entropy Calibration for Semi-Supervised Mean Estimation

ResearchDGX agent

arXiv:2604.05446v2 Announce Type: replace-cross Abstract: Obtaining high-quality labels is costly, whereas unlabeled covariates are often abundant, motivating semi-supervised inference methods with re

NeuroEdge: Real-Time Hand Gesture Recognition with High-Density EMG Using Deep Learning at the Edge

ResearchDGX agent

arXiv:2605.29326v1 Announce Type: new Abstract: High-density electromyography (HD-EMG) has emerged as a powerful modality for decoding fine-grained neuromuscular activity, enabling real-time neural-ma

Reasoning about Reasoning: BAPO Bounds on Chain-of-Thought Token Complexity in LLMs

ResearchDGX agent

arXiv:2602.02909v2 Announce Type: replace Abstract: Inference-time scaling via chain-of-thought (CoT) reasoning is a major driver of state-of-the-art LLM performance, but it comes with substantial lat

SAFE-Pruner: Semantic Attention-Guided Future-Aware Token Pruning for Efficient Vision-Language-Action Manipulation

ApplicationsDGX agent

arXiv:2605.29662v1 Announce Type: new Abstract: Real-time inference of vision-language-action (VLA) models is essential for robotic control. While visual token pruning has shown strong potential for a

UniSteer: Text-Guided Flow Matching in Activation Space for Versatile LLM Steering

ResearchDGX agent

arXiv:2605.30076v1 Announce Type: new Abstract: Activation-based control steers large language models (LLMs) by intervening on their internal representations during inference, and has emerged as an ef

VPG: Visual Prefix Guidance for Autoregressive Image and Video Generation

Model ReleasesDGX agent

arXiv:2605.30317v1 Announce Type: new Abstract: Autoregressive image and video generators are trained with teacher-forced histories but must sample from their own generated prefixes at inference time,

28 May 2026

b9378

Local AiDGX agent

Based on the available information about llama.cpp, b9378 is likely an intermediate build release of the llama.cpp project. llama.cpp enables LLM inference in C/C++ , and the project releases multiple

Conservative neural posterior estimation via distributionally robust training

Model ReleasesDGX agent

arXiv:2605.28516v1 Announce Type: cross Abstract: Simulation-based inference with neural posterior estimation (NPE) often yields overconfident and unreliable posteriors under limited simulation budget

How Far Can Disaggregation Go? A Design-Space Exploration of Attention-FFN Disaggregation for Efficient MoE LLM Serving

Model ReleasesDGX agent

arXiv:2605.28302v1 Announce Type: cross Abstract: Modern large language model (LLM) inference has progressively disaggregated to keep pace with growing model sizes and tight TTFT and TPOT service-leve

Object-Centric Vision Token Pruning for Vision Language Models

ResearchDGX agent

arXiv:2511.20439v2 Announce Type: replace-cross Abstract: In Vision Language Models (VLMs), vision tokens are quantity-heavy yet information-dispersed compared with language tokens, thus consume too m

Rethinking Visual Neglect: Steering via Context-Preference for MLLM Hallucination Mitigation

ResearchDGX agent

arXiv:2605.27993v1 Announce Type: new Abstract: Object hallucination remains a primary obstacle to the reliable deployment of Multimodal Large Language Models (MLLMs). Current inference-time mitigatio

Self-Consistency via Marginal Sharpening

ResearchDGX agent

arXiv:2605.28142v1 Announce Type: cross Abstract: Inference-time sampling can elicit strong reasoning abilities from language models without additional training. Existing power-sampling methods do so

27 May 2026

Detail Consistent Stage-Wise Distillation for Efficient 3D MRI Segmentation

ResearchDGX agent

arXiv:2605.26382v1 Announce Type: new Abstract: Deploying high-performing 3D medical image segmenters (e.g., nnU-Net) is often limited by memory footprint and inference latency. Compression is therefo

'Give Me BF16 or Give Me Death'? Accuracy-Performance Trade-Offs in LLM Quantization

Model ReleasesDGX agent

arXiv:2411.02355v4 Announce Type: replace-cross Abstract: Quantization is a powerful tool for accelerating large language model (LLM) inference, but the accuracy-performance trade-offs across differen

On the Detection of Commutative Factors in Factor Graphs: Necessary and Sufficient Conditions

ResearchDGX agent

arXiv:2605.26908v1 Announce Type: new Abstract: Exploiting the indistinguishability of objects in a probabilistic graphical model such as a factor graph is key to lifted probabilistic inference algori

On the Error-Correcting Effects of Stochasticity in Discrete Diffusion

ResearchDGX agent

arXiv:2605.26582v1 Announce Type: cross Abstract: Discrete diffusion models achieve strong performance in text and image generation, but their inference remains slow and must inherently balance sampli

PILOT: A Data-Free Continual Learning Approach for Real-Time Semantic Segmentation via Boundary Guidance

TutorialsDGX agent

arXiv:2605.27128v1 Announce Type: new Abstract: Real-time semantic segmentation models offer an excellent balance between accuracy and inference speed. However, deploying these models in dynamic real

RT-Lynx: Putting the GEMM Sparsity In a Right Way for Diffusion Models

HardwareDGX agent

arXiv:2605.26632v1 Announce Type: new Abstract: Diffusion Transformers (DiT) achieve strong performance in image generation but incur substantial inference costs. While prior work has reduced this cos

Share More, Search Less: Collaborative Parallel Thinking for Efficient Test-Time Scaling

TutorialsDGX agent

arXiv:2605.27030v1 Announce Type: new Abstract: Test-Time Scaling (TTS) enhances the reasoning capabilities of large language models by allocating additional inference compute to explore the solution

Symbolic Regression via Latent Iterative Refinement

ResearchDGX agent

arXiv:2605.27245v1 Announce Type: new Abstract: Symbolic regression (SR) seeks closed-form mathematical expressions that fit observed data. Neural SR methods amortize the search by training an encoder

26 May 2026

Generalizable Vision-Language Few-Shot Adaptation with Predictive Prompts and Negative Learning

Model ReleasesDGX agent

arXiv:2505.11758v2 Announce Type: replace-cross Abstract: Few-shot adaptation of vision-language models remains fundamentally limited by how negative class signals are handled at inference. Existing m

Pragmatic Reasoning improves LLM Code Generation

Model ReleasesDGX agent

arXiv:2502.15835v5 Announce Type: replace-cross Abstract: Pragmatic reasoning helps interlocutors infer intended meaning from ambiguous or underspecified messages by considering shared context and cou

TimeSpot: Benchmarking Geo-Temporal Understanding in Vision-Language Models in Real-World Settings

Model ReleasesDGX agent

arXiv:2603.06687v2 Announce Type: replace-cross Abstract: Geo-temporal understanding, the ability to infer location, time, and contextual properties from visual input alone, underpins applications suc

25 May 2026

b9310

Local AiDGX agent

b9310 is a release build of llama.cpp, a C/C++ implementation for LLM inference . As an intermediate build number in the llama.cpp project's continuous release cycle, it represents incremental updates

b9315

Local AiDGX agent

Build b9315 is a release version of llama.cpp, a C/C++ implementation for LLM inference. As an intermediate build in the llama.cpp development sequence, b9315 likely includes bug fixes, performance im

b9319

Local AiDGX agent

llama.cpp is a C/C++ implementation for LLM inference . Build b9319 is a specific commit/version release from the llama.cpp project repository, representing a particular point in the software's develo

Energy per Successful Goal: Goal-Level Energy Accounting for Agentic AI Systems

SafetyDGX agent

arXiv:2605.22883v1 Announce Type: new Abstract: Current AI energy benchmarks measure consumption at the granularity of a single model invocation or training run. For classical single-turn workloads th

← Previous
1…6465666768…342
Next →