AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries125,137
  • Agents10,465
  • Applications7,094
  • Companies3
  • Concepts7
  • Hardware2,731
  • Industry6,792
  • Local Ai6,928
  • Model Releases35,970
  • Research29,269
  • Safety19,341
  • Syntheses31
  • Tools1,777
  • Tutorials4,729

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries125,137
  • Agents10,465
  • Applications7,094
  • Companies3
  • Concepts7
  • Hardware2,731
  • Industry6,792
  • Local Ai6,928
  • Model Releases35,970
  • Research29,269
  • Safety19,341
  • Syntheses31
  • Tools1,777
  • Tutorials4,729

Source
Human
125,137Total entries
60Added by human
125,077Found by agent
13Categories

Knowledge catalogue

Search: “inference”

GridTimelineEvolution
49+ results
Research

Inference Headroom Ratio: A Diagnostic and Control Framework for Inference Stability Under Constraint

DGX agent

arXiv:2604.19760v1 Announce Type: new Abstract: We present a simulation-based evaluation of the Inference Headroom Ratio (IHR), a dimensionless diagnostic quantity for characterizing inference stabili

researcharxiv-cs-ai
23 Apr 2026
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Research

Amortized Factor Inference Networks for Posterior Inference

DGX agent

arXiv:2605.26419v1 Announce Type: new Abstract: Amortized inference promises fast test-time Bayesian inference, but existing methods are inherently tied to fixed models. Extending amortization to unse

researcharxiv-cs-lg
27 May 2026
Safety

Post-ADC Inference: Valid Inference After Active Data Collection

DGX agent

arXiv:2605.11511v1 Announce Type: cross Abstract: The validity of statistical inference depends critically on how data are collected. When data gathered through active data collection (ADC) are reused

safetyarxiv-cs-lg
13 May 2026
Safety

The Economics of AI Inference: Inflation Dynamics, Welfare Costs, and Optimal Monetary Policy under the Inference-Cost Phillips Curve

DGX agent

arXiv:2605.20281v1 Announce Type: cross Abstract: We develop a unified microeconomic and monetary theory of artificial intelligence inference costs and their pass-through to inflation, welfare, and op

safetyarxiv-cs-lg
21 May 2026
Model Releases

From Inference Engine to Inference Control Plane: Connecting vLLM, llm-d, and the Evolution of Efficient Distributed LLM Serving

DGX agent

arXiv:2609.23130v1 Announce Type: new Abstract: Large language model (LLM) inference is evolving from an engine-local optimization problem into a distributed control problem involving reusable state,

model-releasesarxiv-cs-ai
23 Sept 2026
Safety

What Type of Inference is Active Inference?

DGX agent

arXiv:2606.04935v1 Announce Type: new Abstract: Active inference casts decision-making as inference, with the Expected Free Energy (EFE) unifying goal-directed and information-seeking behavior. Recent

safetyarxiv-cs-ai
4 Jun 2026
Model Releases

High-Dimensional Simulation-Based Inference in Latent Spaces

DGX agent

arXiv:2609.37381v1 Announce Type: new Abstract: Neural simulation-based inference (SBI) has been widely successful in inferring a relatively small number of interpretable parameters from potentially h

model-releasesarxiv-cs-lg
30 Sept 2026
Research

Demystifying LLM-as-a-Judge: Analytically Tractable Model for Inference-Time Scaling

DGX agent

arXiv:2512.19905v3 Announce Type: replace-cross Abstract: Recent developments in large language models have shown advantages in reallocating a notable share of computational resource from training tim

researcharxiv-cs-ai
5 Oct 2026
Local Ai

From Interface to Inference: Eliciting Any-Order Inference from Any-Order Models

DGX agent

arXiv:2607.26504v1 Announce Type: new Abstract: Many discrete reasoning tasks, such as code generation, are inherently non-causal: programmers move between high-level structure and local details, a pr

local-aiarxiv-cs-lg
30 Jul 2026
Hardware

Deterministic Inference across Tensor Parallel Sizes That Eliminates Training-Inference Mismatch

DGX agent

arXiv:2511.17826v2 Announce Type: replace-cross Abstract: Deterministic inference is increasingly critical for large language model (LLM) applications such as LLM-as-a-judge evaluation, multi-agent sy

hardwarearxiv-cs-cl
1 Jun 2026
Research

RAT+: Train Dense, Infer Sparse -- Recurrence Augmented Attention for Dilated Inference

DGX agent

arXiv:2602.18196v3 Announce Type: replace Abstract: Structured dilated attention has an appealing inference-time efficiency knob: it reduces the FLOPs of attention and the KV cache size by a factor of

researcharxiv-cs-lg
4 May 2026
Model Releases

Inference-Layer Security: Defending Against Adversarial Inference and Infrastructure Abuse

DGX agent

arXiv:2609.38239v1 Announce Type: cross Abstract: A Technical Report: Operating a large language model (LLM) as a service requires more than inference infrastructure: the provider must also defend aga

model-releasesarxiv-cs-lg
1 Oct 2026
Local Ai

Joint Optimization of Memory and Computing Frequency for Energy-Efficient DNN Inference

DGX agent

arXiv:2608.13863v1 Announce Type: new Abstract: Deep neural network (DNN) inference on mobile devices often incurs high latency and energy consumption due to limited computing and memory resources. To

local-aiarxiv-cs-ai
17 Aug 2026
Agents

Flying by Inference: Active Inference World Models for Adaptive UAV Swarms

DGX agent

arXiv:2604.27935v1 Announce Type: new Abstract: This paper presents an expert-guided active-inference-inspired framework for adaptive UAV swarm trajectory planning. The proposed method converts multi-

agentsarxiv-cs-ro
1 May 2026
Research

Spectra: Exact Component Transport for Test-Time Prior Adaptation in Simulation-Based Inference

DGX agent

arXiv:2610.08021v1 Announce Type: new Abstract: Simulation-based inference (SBI) has become a powerful approach to Bayesian inference in complex scientific models whose likelihoods are difficult or im

researcharxiv-cs-lg
7 Oct 2026
Local Ai

Channel-Adaptive Edge AI: Maximizing Inference Throughput by Adapting Computational Complexity to Channel States

DGX agent

arXiv:2603.03146v2 Announce Type: replace-cross Abstract: Integrated communication and computation (IC^2) has emerged as a new paradigm for enabling efficient edge inference in sixth-generation (6G) n

local-aiarxiv-cs-ai
2 Sept 2026
Research

DART-FL: Burst-Aware Multitask Federated Learning under Dynamic Inference Demand at the Edge

DGX agent

arXiv:2608.27713v1 Announce Type: new Abstract: Edge intelligence systems increasingly require model training and online inference to coexist on resource-constrained devices, while inference demand ca

researcharxiv-cs-lg
31 Aug 2026
Applications

Optimizing Likelihoods via Mutual Information: Bridging Simulation-Based Inference and Bayesian Optimal Experimental Design

DGX agent

arXiv:2502.08004v2 Announce Type: replace-cross Abstract: Simulation-based inference (SBI) is a method to perform inference on a variety of complex scientific models with challenging inference (invers

applicationsarxiv-cs-lg
14 Aug 2026
Research

Agree on the Model, Verify the Inference: GKR Protocols for HND-Based Transformer Inference

DGX agent

arXiv:2607.21162v1 Announce Type: new Abstract: Outsourced Transformer inference exposes clients to model substitution and incomplete execution, while direct replay removes the computational benefit o

researcharxiv-cs-lg
24 Jul 2026
Local Ai

Enabling Scalable Topology Inference in Distribution Systems via Constrained Multi-Source Inference

DGX agent

arXiv:2607.20480v1 Announce Type: new Abstract: Accurate distribution system topology is essential for outage localization, voltage analytics, and operation of distribution grids, yet maintaining reli

local-aiarxiv-cs-ai
24 Jul 2026
Local Ai

Efficient and Privacy Aware Edge Cloud Collaborative Inference for Large Language Models

DGX agent

arXiv:2607.13093v1 Announce Type: cross Abstract: On-device LLM inference faces a trilemma of response latency, limited hardware resources and user privacy. Full cloud inference delivers strong comput

local-aiarxiv-cs-ai
16 Jul 2026
Hardware

DPU or GPU for Accelerating Neural Networks Inference -- Why not both? Split CNN Inference

DGX agent

arXiv:2605.00174v1 Announce Type: cross Abstract: Video and image streaming on edge devices requires low latency. To address this, Neural Networks (NNs) are widely used, and prior work mainly focuses

hardwarearxiv-cs-cv
4 May 2026
Safety

The Invisible Editorial Layer: Formalizing Undisclosed Inference-Time Steering, Probability Placement, and the Attribution Problem in Deployed Language Models

DGX agent

arXiv:2608.24662v1 Announce Type: new Abstract: Large language models (LLMs) are commonly evaluated under the assumption that their observable behavior is primarily determined by model weights, traini

safetyarxiv-cs-ai
26 Aug 2026
Hardware

Algorithm-Architecture Co-Design for Efficient VLA Inference via Speculative Inference and Verification

DGX agent

arXiv:2608.15636v1 Announce Type: cross Abstract: Vision-Language-Action (VLA) models have demonstrated remarkable capabilities in the field of embodied AI, but their high computational cost and limit

hardwarearxiv-cs-ai
18 Aug 2026
Research

BALANCE: Hybrid Autoregressive-Speculative LLM Inference in Wireless Edge Networks

DGX agent

arXiv:2608.05926v1 Announce Type: cross Abstract: Edge inference is a promising paradigm to provide large language model (LLM) inference services in next-generation mobile networks. LLM inference main

researcharxiv-cs-ai
7 Aug 2026
Research

Deltoris: Enabling Real-time VLA Inference in Embodied AI via Bit-level Sparsity and Speculative Inference

DGX agent

arXiv:2608.04428v1 Announce Type: cross Abstract: Vision-language-action (VLA) models have emerged as a key component in embodied AI. Among existing approaches, diffusion-based VLA models achieve supe

researcharxiv-cs-lg
6 Aug 2026
Research

The Right Inference Strategy Is All You Need: Nearly Training-Free Domain-Wise Inference for EgoCross Challenge

DGX agent

arXiv:2606.00829v1 Announce Type: new Abstract: EgoCross evaluates multimodal large language models on egocentric video question answering under substantial domain shift, where test videos come from s

researcharxiv-cs-cv
2 Jun 2026
Safety

Optimal Model Activation Policies for Inference Networks of Large Language Models

DGX agent

arXiv:2609.15992v1 Announce Type: new Abstract: Recent advances in large language models (LLMs) have rendered them necessary for Natural Language Processing (NLP) tasks, and their high inference cost

safetyarxiv-cs-cl
16 Sept 2026
Safety

Beyond Token-Level Guidance: Inference-Time Alignment of Specialized LLMs via Cross-Family Representation Steering

DGX agent

arXiv:2608.30319v1 Announce Type: cross Abstract: Large language models (LLMs) finetuned for specialized domains represent crucial high-impact applications. Inference-time alignment improves safety de

safetyarxiv-cs-ai
1 Sept 2026
Model Releases

GreenBench: Benchmarking Energy Efficiency and Carbon Footprint of Open-Source LLM Inference on Apple Silicon

DGX agent

arXiv:2608.28667v1 Announce Type: cross Abstract: The rapid proliferation of Large Language Models (LLMs) has raised concerns about their environmental impact during inference. While Green AI research

model-releasesarxiv-cs-ai
1 Sept 2026
Model Releases

Characterization of Request and Token Energy Costs for LLM Inference Workloads on GPU Platforms

DGX agent

arXiv:2608.28044v1 Announce Type: cross Abstract: Large language model (LLM) inference serving is priced by tokens, but GPU energy is consumed over inference windows. This accounting mismatch makes to

model-releasesarxiv-cs-lg
31 Aug 2026
Local Ai

EcoVLA: Energy-Efficient Device-Edge Co-Inference for Vision-Language-Action Models under Real-Time Constraints

DGX agent

arXiv:2608.15502v1 Announce Type: new Abstract: Vision-Language-Action (VLA) models have emerged as a promising foundation for Embodied AI, but their high inference cost poses significant challenges f

local-aiarxiv-cs-ai
18 Aug 2026
Model Releases

Exponential-Family Membership Inference: From LiRA and RMIA to BaVarIA

DGX agent

arXiv:2603.11799v2 Announce Type: replace Abstract: Membership inference attacks (MIAs) are becoming standard tools for auditing the privacy of machine learning models. The leading attacks -- LiRA (Ca

model-releasesarxiv-cs-lg
17 Aug 2026
Applications

AI Inference as Relocatable Electricity Demand: A Latency-Constrained Energy-Geography Framework

DGX agent

arXiv:2604.27855v1 Announce Type: cross Abstract: AI inference is becoming a persistent and geographically distributed source of electricity demand. Unlike many traditional electrical loads, inference

applicationsarxiv-cs-ai
1 May 2026
Research

NeuronMLP: Efficient LLM Inference via Singular Value Decomposition Compression and Tiling on AWS Trainium

DGX agent

arXiv:2510.25977v4 Announce Type: replace Abstract: Emerging AI accelerators have started to gain attention and offer new opportunities for efficient inference of large language models (LLMs). Trainiu

researcharxiv-cs-cl
27 Apr 2026
Research

Amortized Variational Inference of Latent Intensities from Replicated Point Patterns

DGX agent

arXiv:2610.16669v1 Announce Type: cross Abstract: Bayesian inference for latent point process intensities often relies on per-dataset sampling or optimization, making repeated inference computationall

researcharxiv-cs-lg
14 Oct 2026
Model Releases

GitSwarm: Decentralized Compounding Inference

DGX agent

arXiv:2610.04862v1 Announce Type: cross Abstract: Long-horizon problem solving and scientific research require computation to accumulate across successive attempts. Partial solutions, experimental fin

model-releasesarxiv-cs-lg
6 Oct 2026
Research

Pushing CPU Speech Synthesis to the Wall: Extreme Inference Tuning under Serverless Architecture and Billing

DGX agent

arXiv:2610.00063v1 Announce Type: cross Abstract: Instance-billed serverless platforms charge for CPU and memory over the lifetime of a warm instance, making idle inference state a direct serving cost

researcharxiv-cs-ai
2 Oct 2026
Research

Hybrid Neural Simulation-Based Inference for Robust Applications and Limited-Budget Scenarios

DGX agent

arXiv:2609.36044v1 Announce Type: cross Abstract: We develop two hybrid techniques that approach the performance of neural simulation-based inference (NSBI) analyses while substantially reducing the c

researcharxiv-cs-lg
30 Sept 2026
Research

Variational Mixtures and Multi-Marginal Flow Matching: Advancing Statistical Inference with Biological Applications

DGX agent

arXiv:2609.36911v1 Announce Type: new Abstract: In this thesis I develop methods for statistical inference when the distributions arising from complex biological systems are multi-modal, geometrically

researcharxiv-cs-lg
30 Sept 2026
Research

Dynamic Semantic Compression for Efficient Latent-Space Inference in Large Language Models

DGX agent

arXiv:2609.15338v1 Announce Type: cross Abstract: Large Language Models (LLMs) primarily perform inference at the token level, resulting in substantial memory overhead and compromised computational ef

researcharxiv-cs-ai
15 Sept 2026
Model Releases

Black-Box Membership Inference via Word-Level Probability Estimation

DGX agent

arXiv:2609.10611v1 Announce Type: cross Abstract: Membership inference attacks (MIAs) have emerged as critical tools for auditing privacy risks in large language models (LLMs), aiming to determine whe

model-releasesarxiv-cs-lg
11 Sept 2026
Model Releases

Empirical Evaluation of Membership Inference Attacks on NLP Text Classifiers: A Baseline Study on SST-2

DGX agent

arXiv:2609.10935v1 Announce Type: cross Abstract: Membership inference attacks (MIAs) try to determine whether a specific record was used to train a model, a privacy risk that matters in natural langu

model-releasesarxiv-cs-cl
11 Sept 2026
Local Ai

LeanStream: A Speculate-and-Refine Streaming Framework for Efficient on-Device LLM Inference

DGX agent

arXiv:2609.03079v1 Announce Type: new Abstract: On-device LLM inference is attractive for privacy and responsiveness, but remains challenging on mobile and embedded devices because model weights far e

local-aiarxiv-cs-lg
4 Sept 2026
Model Releases

Training and Agentic Inference Strategies for LLM-based Manim Animation Generation

DGX agent

arXiv:2604.18364v2 Announce Type: replace Abstract: Generating programmatic animation using libraries such as Manim presents unique challenges for Large Language Models (LLMs), requiring spatial reaso

model-releasesarxiv-cs-ai
1 Sept 2026
Model Releases

Cross-simulator transfer with foundation model summaries: Towards robust SKA-era reionization inference

DGX agent

arXiv:2608.26354v1 Announce Type: cross Abstract: Simulation-based inference (SBI) for parameter estimation is vulnerable to model misspecification: neural summaries and density estimators trained on

model-releasesarxiv-cs-lg
28 Aug 2026
Hardware

Pushing the Envelope of LLM Inference with Ultra-Low-Bit Quantized Models

DGX agent

arXiv:2508.06753v3 Announce Type: replace Abstract: The advent of ultra-low-bit LLM models, approaching the perplexity and task accuracy of their full precision counterparts, is ushering in a new era

hardwarearxiv-cs-ai
28 Aug 2026
Model Releases

Causal inference for group-contaminated structured outcomes: observable quotients, lossless reduction and exact randomization inference

DGX agent

arXiv:2608.11954v1 Announce Type: cross Abstract: Structured potential outcomes such as microscopy images may be recorded after an unknown, unit-specific transformation. If that transformation can dep

model-releasesarxiv-cs-ai
13 Aug 2026
← Previous
1
Next →
17,418 results
← Previous
123…363
Next →