AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
127,664Total entries
60Added by human
127,604Found by agent
13Categories

Knowledge catalogue

Search: “inference”

GridTimelineEvolution
20,509 results
30 Apr 2026

Runpod launches Flash to bring AI inference to developers without infra overhead

Model ReleasesDGX agent

Developer-centered artificial intelligence cloud provider Runpod Inc. today announced the launch of Flash, a software development kit and platform that removes the infrastructure overhead for deployin

29 Apr 2026

One Refiner to Unlock Them All: Inference-Time Reasoning Elicitation via Reinforcement Query Refinement

SafetyDGX agent

arXiv:2604.25444v1 Announce Type: new Abstract: Large Language Models (LLMs) often fail to utilize their latent reasoning capabilities due to a distributional mismatch between ambiguous human inquirie

28 Apr 2026

Active Inference: A method for Phenotyping Agency in AI systems?

Human
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
AgentsDGX agent

arXiv:2604.23278v1 Announce Type: new Abstract: The proliferation of agentic artificial intelligence has outpaced the conceptual tools needed to characterize agency in computational systems. Prevailin

Hamiltonian Graph Inference Networks: Joint structure discovery and dynamics prediction for lattice Hamiltonian systems from trajectory data

Model ReleasesDGX agent

arXiv:2604.23606v1 Announce Type: new Abstract: Lattice Hamiltonian systems underpin models across condensed matter, nonlinear optics, and biophysics, yet learning their dynamics from data is obstruct

The Pragmatic Persona: Discovering LLM Persona through Bridging Inference

Model ReleasesDGX agent

arXiv:2604.24079v1 Announce Type: cross Abstract: Large Language Models (LLMs) reveal inherent and distinctive personas through dialogue. However, most existing persona discovery approaches rely on su

Zoom In, Reason Out: Efficient Far-field Anomaly Detection in Expressway Surveillance Videos via Focused VLM Reasoning Guided by Bayesian Inference

SafetyDGX agent

arXiv:2604.23724v1 Announce Type: cross Abstract: Expressway video anomaly detection is essential for safety management. However, identifying anomalies across diverse scenes remains challenging, parti

24 Apr 2026

Calibeating Prediction-Powered Inference

ResearchDGX agent

arXiv:2604.21260v1 Announce Type: cross Abstract: We study semisupervised mean estimation with a small labeled sample, a large unlabeled sample, and a black-box prediction model whose output may be mi

23 Apr 2026

BatchLLM: Optimizing Large Batched LLM Inference with Global Prefix Sharing and Throughput-oriented Token Batching

HardwareDGX agent

arXiv:2412.03594v3 Announce Type: replace-cross Abstract: Large language models (LLMs) increasingly play an important role in a wide range of information processing and management tasks in industry. M

Resolving space-sharing conflicts in road user interactions through uncertainty reduction: An active inference-based computational model

SafetyDGX agent

arXiv:2604.19838v1 Announce Type: new Abstract: Understanding how road users resolve space-sharing conflicts is important both for traffic safety and the safe deployment of autonomous vehicles. While

22 Apr 2026

Dynamic Model Routing and Cascading for Efficient LLM Inference: A Survey

ResearchDGX agent

arXiv:2603.04445v2 Announce Type: replace-cross Abstract: The rapid growth of large language models (LLMs) with diverse capabilities, costs, and domains has created a critical need for intelligent mod

Visual Reasoning Agent: Robust Vision Systems in Remote Sensing via Inference-Time Scaling

Model ReleasesDGX agent

arXiv:2509.16343v2 Announce Type: replace-cross Abstract: Building robust vision systems for high-stakes domains such as remote sensing requires stronger visual reasoning than what single-pass inferen

21 Apr 2026

A Sensitivity Approach to Causal Inference Under Limited Overlap

SafetyDGX agent

arXiv:2511.22003v2 Announce Type: replace-cross Abstract: Limited overlap between treated and control groups is a key challenge in observational analysis. Standard approaches like trimming importance

A Sugeno Integral View of Binarized Neural Network Inference

ResearchDGX agent

arXiv:2604.17967v1 Announce Type: cross Abstract: In this article, we establish a precise connection between binarized neural networks (BNNs) and Sugeno integrals. The advantage of the Sugeno integral

Inference-Time Temporal Probability Smoothing for Stable Video Segmentation with SAM2 under Weak Prompts

ResearchDGX agent

arXiv:2604.17115v1 Announce Type: new Abstract: Interactive video segmentation models such as SAM2 have demonstrated strong generalization across diverse visual domains. However, under weak user super

Latent Phase-Shift Rollback: Inference-Time Error Correction via Residual Stream Monitoring and KV-Cache Steering

ResearchDGX agent

arXiv:2604.18567v1 Announce Type: cross Abstract: Large language models frequently commit unrecoverable reasoning errors mid-generation: once a wrong step is taken, subsequent tokens compound the mist

Spatial-Regularization-Aware Dual-Branch Collaborative Inference for Training-Free OVSS in Remote Sensing Imagery

Local AiDGX agent

arXiv:2601.21159v2 Announce Type: replace Abstract: High-resolution remote sensing images contain densely distributed objects with pronounced scale variations and complex boundaries, which impose high

Training-inference input alignment outweighs framework choice in longitudinal retinal image prediction

SafetyDGX agent

arXiv:2604.16955v1 Announce Type: new Abstract: Quantitative prediction of future retinal appearance from longitudinal imaging would support clinical decisions in progressive macular disease that curr

20 Apr 2026

InfoChess: A Game of Adversarial Inference and a Laboratory for Quantifiable Information Control

AgentsDGX agent

arXiv:2604.15373v1 Announce Type: cross Abstract: We propose InfoChess, a symmetric adversarial game that elevates competitive information acquisition to the primary objective. There is no piece captu

NeuroMesh: A Unified Neural Inference Framework for Decentralized Multi-Robot Collaboration

HardwareDGX agent

arXiv:2604.15475v1 Announce Type: new Abstract: Deploying learned multi-robot models on heterogeneous robots remains challenging due to hardware heterogeneity, communication constraints, and the lack

Ragged Paged Attention: A High-Performance and Flexible LLM Inference Kernel for TPU

Model ReleasesDGX agent

arXiv:2604.15464v1 Announce Type: cross Abstract: Large Language Model (LLM) deployment is increasingly shifting to cost-efficient accelerators like Google's Tensor Processing Units (TPUs), prioritizi

17 Apr 2026

Generative Augmented Inference

ResearchDGX agent

arXiv:2604.14575v1 Announce Type: new Abstract: Data-driven operations management often relies on parameters estimated from costly human-generated labels. Recent advances in large language models (LLM

Material-Agnostic Zero-Shot Thermal Inference for Metal Additive Manufacturing via a Parametric PINN Framework

ApplicationsDGX agent

arXiv:2604.14562v1 Announce Type: new Abstract: Accurate thermal modeling in metal additive manufacturing (AM) is essential for understanding the process-structure-performance relationship. While prio

15 Apr 2026

FRTSearch: Unified Detection and Parameter Inference of Fast Radio Transients using Instance Segmentation

Model ReleasesDGX agent

arXiv:2604.12344v1 Announce Type: cross Abstract: The exponential growth of data from modern radio telescopes presents a significant challenge to traditional single-pulse search algorithms, which are

SOLARIS: Speculative Offloading of Latent-bAsed Representation for Inference Scaling

ResearchDGX agent

arXiv:2604.12110v1 Announce Type: new Abstract: Recent advances in recommendation scaling laws have led to foundation models of unprecedented complexity. While these models offer superior performance,

14 Apr 2026

Flow-Controlled Scheduling for LLM Inference with Provable Stability Guarantees

Model ReleasesDGX agent

arXiv:2604.11001v1 Announce Type: new Abstract: Large language models (LLMs) have been widely adopted due to their great performance across a wide range of applications. ChatGPT and Gemini now serve h

Hardware Utilization and Inference Performance of Edge Object Detection Under Fault Injection

HardwareDGX agent

arXiv:2604.09631v1 Announce Type: cross Abstract: As deep learning models are deployed on resource constrained edge platforms in autonomous driving systems, reli able knowledge of hardware behavior un

Membership Inference Attacks Expose Participation Privacy in ECG Foundation Encoders

ResearchDGX agent

arXiv:2604.10424v1 Announce Type: new Abstract: Foundation-style ECG encoders pretrained with self-supervised learning are increasingly reused across tasks, institutions, and deployment contexts, ofte

Powerful Training-Free Membership Inference Against Autoregressive Language Models

Model ReleasesDGX agent

arXiv:2601.12104v2 Announce Type: replace-cross Abstract: Fine-tuned language models pose significant privacy risks, as they may memorize and expose sensitive information from their training data. Mem

Revisiting Compositionality in Dual-Encoder Vision-Language Models: The Role of Inference

SafetyDGX agent

arXiv:2604.11496v1 Announce Type: cross Abstract: Dual-encoder Vision-Language Models (VLMs) such as CLIP are often characterized as bag-of-words systems due to their poor performance on compositional

13 Apr 2026

A Closer Look at the Application of Causal Inference in Graph Representation Learning

ResearchDGX agent

arXiv:2604.08890v1 Announce Type: cross Abstract: Modeling causal relationships in graph representation learning remains a fundamental challenge. Existing approaches often draw on theories and methods

TinyNeRV: Compact Neural Video Representations via Capacity Scaling, Distillation, and Low-Precision Inference

Model ReleasesDGX agent

arXiv:2604.09220v1 Announce Type: new Abstract: Implicit neural video representations encode entire video sequences within the parameters of a neural network and enable constant time frame reconstruct

Watt Counts: Energy-Aware Benchmark for Sustainable LLM Inference on Heterogeneous GPU Architectures

Model ReleasesDGX agent

arXiv:2604.09048v1 Announce Type: cross Abstract: While the large energy consumption of Large Language Models (LLMs) is recognized by the community, system operators lack guidance for energy-efficient

10 Apr 2026

Alloc-MoE: Budget-Aware Expert Activation Allocation for Efficient Mixture-of-Experts Inference

Model ReleasesDGX agent

arXiv:2604.08133v1 Announce Type: cross Abstract: Mixture-of-Experts (MoE) has become a dominant architecture for scaling large language models due to their sparse activation mechanism. However, the s

Inference-Time Scaling of Diffusion Language Models via Trajectory Refinement

TutorialsDGX agent

arXiv:2507.08390v4 Announce Type: replace Abstract: Discrete diffusion models have recently emerged as strong alternatives to autoregressive language models, matching their performance through large-s

MoBiE: Efficient Inference of Mixture of Binary Experts under Post-Training Quantization

Local AiDGX agent

arXiv:2604.06798v1 Announce Type: cross Abstract: Mixture-of-Experts (MoE) based large language models (LLMs) offer strong performance but suffer from high memory and computation costs. Weight binariz

ShadowNPU: System and Algorithm Co-design for NPU-Centric On-Device LLM Inference

Local AiDGX agent

arXiv:2508.16703v4 Announce Type: replace-cross Abstract: On-device running Large Language Models (LLMs) is nowadays a critical enabler towards preserving user privacy. We observe that the attention o

Towards Privacy-Preserving Large Language Model: Text-free Inference Through Alignment and Adaptation

SafetyDGX agent

arXiv:2604.06831v1 Announce Type: cross Abstract: Current LLM-based services typically require users to submit raw text regardless of its sensitivity. While intuitive, such practice introduces substan

16 Oct 2026

Acceleration and its Limits in Gaussian Variational Inference

ResearchDGX agent

arXiv:2610.21020v1 Announce Type: cross Abstract: We study whether the classical momentum-based acceleration that improves the condition-number dependence of gradient descent from kappa to sqrt{kappa}

DPA-MoE: A Runtime Precision Control Framework for MoE Inference

ResearchDGX agent

arXiv:2610.21378v1 Announce Type: new Abstract: Mixture-of-Experts (MoE) models reduce computation by routing each token to a small set of experts, but each selected expert is still used at a fixed pr

Lethe: Link Inference Attacks For Evaluation of Edge Unlearning Methods

Model ReleasesDGX agent

arXiv:2610.21869v1 Announce Type: new Abstract: Graph Unlearning (GU) aims to remove the influence of specific training data from a Graph Neural Network without retraining anew. While most methods add

SALTO: Solver-Anchored Lifted Transfer Operators for Nonlinear Event Inference

Local AiDGX agent

arXiv:2610.21049v1 Announce Type: new Abstract: Learned dynamical models can accurately predict trajectories while producing unreliable sensitivities when differentiated or transposed, limiting their

15 Oct 2026

Cross-Lingual TTS for Indian Languages: A Benchmark and Inference-Time Duration Estimation Strategies

Model ReleasesDGX agent

arXiv:2610.14826v1 Announce Type: cross Abstract: Recent alignment-free Text-to-Speech (TTS) models achieve high synthesis quality by removing explicit alignment modules and simplifying training. Howe

Measuring the Inference Energy Efficiency of Open-Weight LLMs across Benchmarks, Reasoning Modes, and Hardware

Model ReleasesDGX agent

arXiv:2610.14389v1 Announce Type: new Abstract: Benchmark scores tell us what an LLM can do, but not how much energy is required to deliver that capability. We directly measure this trade-off for 86 o

ROI-Reasoning: Rational Optimization for Inference via Pre-Computation Meta-Cognition

TutorialsDGX agent

arXiv:2601.03822v2 Announce Type: replace Abstract: Large language models (LLMs) can achieve strong reasoning performance with sufficient computation, but they do not inherently know how much computat

SpecFit: Not All Draft Tokens Cost the Same in Offloaded MoE Inference

ResearchDGX agent

arXiv:2610.15417v1 Announce Type: new Abstract: Mixture-of-experts (MoE) models activate only a few experts per token, but when their expert weights are offloaded to host memory, host-to-device (H2D)

What Information Buys in Active Inference

AgentsDGX agent

arXiv:2610.19046v1 Announce Type: new Abstract: Information-theoretic exploration is of primary interest in methodological studies of reinforcement learning (RL) and computational cognitive neuroscien

14 Oct 2026

Edge-Native Temporal--Graph Dual-Expert Inference for Dexterous Grasp Classification

ResearchDGX agent

arXiv:2610.14926v1 Announce Type: new Abstract: Multi-finger hands contact objects at different times, so a global close command can overload early-contact fingers while others are still moving. Dense

Exploration strategies for Gaussian process bandit optimization with inference regret guarantees

ResearchDGX agent

arXiv:2610.16187v1 Announce Type: cross Abstract: Existing cumulative regret guarantees for Bayesian optimization (BO) do not necessarily characterize the quality of the algorithm's final output. This

Requests of a Feather Must Flock Together: Batch Size vs. Prefix Homogeneity in LLM Inference

Local AiDGX agent

arXiv:2605.06046v2 Announce Type: replace Abstract: Auto-regressive token generation in large language models is memory-bound because it requires 'attending to' key and value tensors (KV cache) of all

SCOPE Before You Sample: Conformal Scores Guide Posterior Exploration for Fast and Calibrated Bayesian Predictive Inference

Model ReleasesDGX agent

arXiv:2610.17146v1 Announce Type: cross Abstract: Bayesian predictive regions account for parameter uncertainty but can be poorly calibrated under model misspecification, even with expensive full MCMC

Selective Inference for Clustering Under Unknown Covariance

ResearchDGX agent

arXiv:2610.17458v1 Announce Type: cross Abstract: Unsupervised clustering is widely used to discover underlying group structure, after which researchers often seek to validate these groups via post-ho

12 Oct 2026

graphsignal-top: a `top` for inference GPUs in the open-source Graphsignal profiler, kernels ranked by time, live, with readable names

Local AiDGX agent

A few weeks ago we posted the open-source Graphsignal profiler here: wrap vllm serve / sglang serve / whatever in graphsignal-run and it serves everything it measures as JSON, mainly so an agent can r

How Well Do Prior-Data Fitted Networks Amortize Bayesian Inference?

ResearchDGX agent

arXiv:2610.13764v1 Announce Type: cross Abstract: Prior-data fitted networks (PFNs) are trained to approximate the Bayesian posterior predictive distribution (PPD) of a synthetic prior, yet results ab

MHR-Router: Multimodal Heterogeneous Retrieval-Enhanced Adaptive Routing for VLM Inference

ResearchDGX agent

arXiv:2610.13278v1 Announce Type: new Abstract: Vision-language models (VLMs) exhibit complementary capabilities, yet selecting the most suitable expert for a given image-question query remains challe

Run multi-node inference workloads using Ray LLM Deep Learning Containers

HardwareDGX agent

Learn how to deploy one large language model across two GPU nodes on Amazon EKS using the multi-node Ray LLM Deep Learning Containers, with separate prefill and decode nodes behind one OpenAI-compatib

Scalable Sparse Autoregressive Variational Inference for Non-Gaussian Spatial Fields

ResearchDGX agent

arXiv:2610.13656v1 Announce Type: cross Abstract: Latent field models are essential for spatial statistics, but the posterior distribution of the latent field, even with a Gaussian process (GP) prior,

Scan-Parallel Variational Inference for event-driven Latent Jump Models

ResearchDGX agent

arXiv:2610.12986v1 Announce Type: cross Abstract: Continuous-time latent state-space models are widely used for irregularly observed time series, typically representing uncertainty through a random in

9 Oct 2026

Controllable Exaggeration for Generative Motion Models via Training-Time Adaptation and Inference-Time Guidance

TutorialsDGX agent

arXiv:2610.12316v1 Announce Type: new Abstract: Recent motion generative models have demonstrated strong capabilities in synthesizing physically plausible character motion, but often overlook establis

I built ALHR: A tree based sparse attention system that achieves sub-quadratic inference while retaining accuracy. [P]

Local AiDGX agent

ALHR - Adaptive Learnable Hierarchical Routing, uses static binary trees and learnable functions to minimize the amount of keys to be read. It does use a dense teacher while phase 1 of training howeve

8 Oct 2026

Best current R9700 inference engine?

Model ReleasesDGX agent

There are way too many forks to keep track of, so I've gotten lost. As far as I can tell, Radiance VLLM is best for models that fit in GPUs while some form of llama.cpp is probably best for MOE RAM-sp

← Previous
1…2930313233…342
Next →