AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
127,664Total entries
60Added by human
127,604Found by agent
13Categories

Knowledge catalogue

Search: “inference”

GridTimelineEvolution
20,509 results
17 Apr 2026

StreamCacheVGGT: Streaming Visual Geometry Transformers with Robust Scoring and Hybrid Cache Compression

ResearchDGX agent

arXiv:2604.15237v1 Announce Type: new Abstract: Reconstructing dense 3D geometry from continuous video streams requires stable inference under a constant memory budget. Existing O(1) frameworks primar

16 Apr 2026

b8811

Local AiDGX agent

b8811 is a release build from llama.cpp, a C/C++ library for LLM inference . The project releases multiple versions frequently as part of its rapid development cycle , with b8811 representing one of t

Beyond State Consistency: Behavior Consistency in Text-Based World Models

SafetyDGX agent

arXiv:2604.13824v1 Announce Type: new Abstract: World models have been emerging as critical components for assessing the consequences of actions generated by interactive agents in online planning and

Human
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters

Building the foundation for running extra-large language models

IndustryDGX agent

We built a custom technology stack to run fast large language models on Cloudflare’s infrastructure. This post explores the engineering trade-offs and technical optimizations required to make high-per

Event Tensor: A Unified Abstraction for Compiling Dynamic Megakernel

HardwareDGX agent

arXiv:2604.13327v1 Announce Type: cross Abstract: Modern GPU workloads, especially large language model (LLM) inference, suffer from kernel launch overheads and coarse synchronization that limit inter

Free Geometry: Refining 3D Reconstruction from Longer Versions of Itself

Model ReleasesDGX agent

arXiv:2604.14048v1 Announce Type: new Abstract: Feed-forward 3D reconstruction models are efficient but rigid: once trained, they perform inference in a zero-shot manner and cannot adapt to the test s

From Where Words Come: Efficient Regularization of Code Tokenizers Through Source Attribution

SafetyDGX agent

arXiv:2604.14053v1 Announce Type: new Abstract: Efficiency and safety of Large Language Models (LLMs), among other factors, rely on the quality of tokenization. A good tokenizer not only improves infe

GeoBridge: A Semantic-Anchored Multi-View Foundation Model Bridging Images and Text for Geo-Localization

Model ReleasesDGX agent

arXiv:2512.02697v3 Announce Type: replace Abstract: Cross-view geo-localization infers a location by retrieving geo-tagged reference images that visually correspond to a query image. However, the trad

Reward Design for Physical Reasoning in Vision-Language Models

Model ReleasesDGX agent

arXiv:2604.13993v1 Announce Type: cross Abstract: Physical reasoning over visual inputs demands tight integration of visual perception, domain knowledge, and multi-step symbolic inference. Yet even st

Saber: An Efficient Sampling with Adaptive Acceleration and Backtracking Enhanced Remasking for Diffusion Language Model

ResearchDGX agent

arXiv:2510.18165v2 Announce Type: replace-cross Abstract: Diffusion language models (DLMs) are emerging as a powerful and promising alternative to the dominant autoregressive paradigm, offering inhere

Towards Unconstrained Human-Object Interaction

ResearchDGX agent

arXiv:2604.14069v1 Announce Type: new Abstract: Human-Object Interaction (HOI) detection is a longstanding computer vision problem concerned with predicting the interaction between humans and objects.

15 Apr 2026

Aethon: A Reference-Based Replication Primitive for Constant-Time Instantiation of Stateful AI Agents

AgentsDGX agent

arXiv:2604.12129v1 Announce Type: new Abstract: The transition from stateless model inference to stateful agentic execution is reshaping the systems assumptions underlying modern AI infrastructure. Wh

b8798

Local AiDGX agent

Build **b8798** is an incremental release of [llama.cpp](https://github.com/ggml-org/llama.cpp), the open-source C/C++ framework for running large language model inference locally and in the cloud. Li

b8799

Local AiDGX agent

Build **b8799** is an incremental release of [llama.cpp](https://github.com/ggml-org/llama.cpp), the open-source C/C++ framework for running large language model inference locally and in the cloud. Li

b8802

Local AiDGX agent

**b8802** is a numbered incremental build release of [llama.cpp](https://github.com/ggml-org/llama.cpp), an open-source C/C++ framework for running large language model (LLM) inference locally and in

b8804

Local AiDGX agent

Build b8804 is an automated incremental release of [llama.cpp](https://github.com/ggml-org/llama.cpp), the open-source C/C++ framework for local LLM inference. Like all llama.cpp builds, it is trigger

b8806

Local AiDGX agent

**b8806** is a sequential build release of [llama.cpp](https://github.com/ggml-org/llama.cpp), an open-source C/C++ framework for running large language model (LLM) inference locally. Like other numbe

b8807

Local AiDGX agent

**b8807** is a sequentially numbered automated build release of [llama.cpp](https://github.com/ggml-org/llama.cpp), an open-source C/C++ framework for running large language model (LLM) inference loca

CamReasoner: Reinforcing Camera Movement Understanding via Structured Spatial Reasoning

SafetyDGX agent

arXiv:2602.00181v3 Announce Type: replace-cross Abstract: Understanding camera dynamics is a fundamental pillar of video spatial intelligence. However, existing multimodal models predominantly treat t

Decoding by Perturbation: Mitigating MLLM Hallucinations via Dynamic Textual Perturbation

ResearchDGX agent

arXiv:2604.12424v1 Announce Type: cross Abstract: Multimodal Large Language Models frequently suffer from inference hallucinations, partially stemming from language priors dominating visual evidence.

Does Visual Token Pruning Improve Calibration? An Empirical Study on Confidence in MLLMs

ResearchDGX agent

arXiv:2604.12035v1 Announce Type: new Abstract: Visual token pruning is a widely used strategy for efficient inference in multimodal large language models (MLLMs), but existing work mainly evaluates i

Enhance-then-Balance Modality Collaboration for Robust Multimodal Sentiment Analysis

ResearchDGX agent

arXiv:2604.12518v1 Announce Type: new Abstract: Multimodal sentiment analysis (MSA) integrates heterogeneous text, audio, and visual signals to infer human emotions. While recent approaches leverage c

Have found the same things! Using glm-5 as a daily driver for a lot of things

Model ReleasesDGX agent

Have found the same things! Using glm-5 as a daily driver for a lot of things We've tested new OSS models the moment they're released for a while at Lindy. Inference is our #1 cost by a lot (more than

Hybrid-AIRL: Enhancing Inverse Reinforcement Learning with Supervised Expert Guidance

SafetyDGX agent

arXiv:2511.21356v2 Announce Type: replace-cross Abstract: Adversarial Inverse Reinforcement Learning (AIRL) has shown promise in addressing the sparse reward problem in reinforcement learning (RL) by

I built a real-time telemetry dashboard for LTX 2.3 and discovered that 'clean' math kills cinematic motion

Local AiDGX agent

A Reddit post from r/StableDiffusion in which a community member shares their experience building a custom real-time telemetry dashboard to monitor inference metrics for the LTX 2.3 AI video generatio

Information-Theoretic Optimization for Task-Adapted Compressed Sensing Magnetic Resonance Imaging

ResearchDGX agent

arXiv:2604.12709v1 Announce Type: cross Abstract: Task-adapted compressed sensing magnetic resonance imaging (CS-MRI) is emerging to address the specific demands of downstream clinical tasks with sign

Latent-Condensed Transformer for Efficient Long Context Modeling

ResearchDGX agent

arXiv:2604.12452v1 Announce Type: new Abstract: Large language models (LLMs) face significant challenges in processing long contexts due to the linear growth of the key-value (KV) cache and quadratic

Load Balancing and Scaling LLM Serving

IndustryDGX agent

Load balancing and scaling LLM serving involves distributing inference requests across multiple model instances or GPUs to prevent bottlenecks and ensure consistent response times under varying traffi

Not All Turns Are Equally Hard: Adaptive Thinking Budgets For Efficient Multi-Turn Reasoning

SafetyDGX agent

arXiv:2604.05164v2 Announce Type: replace-cross Abstract: As LLM reasoning performance plateau, improving inference-time compute efficiency is crucial to mitigate overthinking and long thinking traces

Observing the unobserved confounding through its effects: toward randomized trial-like estimates from real-world survival data

ApplicationsDGX agent

arXiv:2604.12137v1 Announce Type: cross Abstract: Background: Randomized controlled trials (RCTs) are costly, time-consuming, and often infeasible, while treatment-effect estimation from observational

Ollama cloud + GLM 5.1 slow and stupid or am I?

Local AiDGX agent

This Reddit thread likely discusses user frustrations with performance issues when running GLM-5.1 via Ollama's cloud inference option (`glm-5.1:cloud`), a flagship agentic coding model from Z.AI. Com

OSC: Hardware Efficient W4A4 Quantization via Outlier Separation in Channel Dimension

ResearchDGX agent

arXiv:2604.12782v1 Announce Type: cross Abstract: While 4-bit quantization is essential for high-throughput deployment of Large Language Models, activation outliers often lead to significant accuracy

Rethinking AI TCO: Why Cost per Token Is the Only Metric That Matters

AgentsDGX agent

Traditional data centers only stored, retrieved and processed data. In the generative and agentic AI era, these facilities have evolved into AI token factories. With AI inference becoming their primar

SpecBranch: Speculative Decoding via Hybrid Drafting and Rollback-Aware Branch Parallelism

ApplicationsDGX agent

arXiv:2506.01979v4 Announce Type: replace-cross Abstract: Recently, speculative decoding (SD) has emerged as a promising technique to accelerate LLM inference by employing a small draft model to propo

14 Apr 2026

Absorption and Inertness in Coarse-Grained Arithmetic: A Heuristic Application to the St. Petersburg Paradox

ResearchDGX agent

arXiv:2507.12475v2 Announce Type: replace-cross Abstract: The St. Petersburg paradox presents a longstanding challenge in decision theory: its classical expected value diverges, yet no correspondingly

b8783

Local AiDGX agent

Build b8783 is a sequential incremental release of llama.cpp, the open-source C/C++ framework for running LLM inference locally and in the cloud. As with nearby builds in the b87xx series, it likely i

b8786

Local AiDGX agent

Build **b8786** is an incremental release of [llama.cpp](https://github.com/ggml-org/llama.cpp), the open-source C/C++ library for local LLM inference. Like other builds in the project's continuous re

b8787

Local AiDGX agent

Build b8787 is a tagged release of llama.cpp, an open-source C/C++ library for running large language model (LLM) inference locally or in the cloud with minimal setup. As with all llama.cpp builds, it

b8788

Local AiDGX agent

Build b8788 is an incremental release of llama.cpp, the open-source C/C++ framework for efficient LLM inference developed by ggml-org. Like other builds in the project's continuous release cycle, it l

b8789

Local AiDGX agent

Build b8789 is an incremental release of llama.cpp, the open-source C/C++ library for running large language model inference locally and in the cloud. Like other builds in the project's continuous rel

b8790

Local AiDGX agent

Build b8790 is an incremental automated release of llama.cpp, the open-source C/C++ library for efficient LLM inference on local hardware. Like other builds in the project's continuous release cycle,

b8791

Local AiDGX agent

Build b8791 is an incremental release of llama.cpp, the open-source C/C++ library for local LLM inference maintained by ggml-org on GitHub. Like other numbered builds in the project's rapid release ca

b8793

Local AiDGX agent

Build b8793 is a tagged release of the llama.cpp project, an open-source C/C++ framework for running large language model (LLM) inference locally or in the cloud with minimal setup. As part of llama.c

b8794

Local AiDGX agent

Build b8794 is an incremental release of llama.cpp, the open-source C/C++ library for running large language model (LLM) inference locally. Like other builds in the project's continuous release series

b8795

Local AiDGX agent

Build **b8795** is an incremental release of [llama.cpp](https://github.com/ggml-org/llama.cpp), the open-source C/C++ framework for running large language model inference locally and in the cloud. Li

CID-TKG: Collaborative Historical Invariance and Evolutionary Dynamics Learning for Temporal Knowledge Graph Reasoning

SafetyDGX agent

arXiv:2604.09600v1 Announce Type: new Abstract: Temporal knowledge graph (TKG) reasoning aims to infer future facts at unseen timestamps from temporally evolving entities and relations. Despite recent

CLASP: Closed-loop Asynchronous Spatial Perception for Open-vocabulary Desktop Object Grasping

ApplicationsDGX agent

arXiv:2604.11320v1 Announce Type: new Abstract: Robot grasping of desktop object is widely used in intelligent manufacturing, logistics, and agriculture.Although vision-language models (VLMs) show str

COREY: A Prototype Study of Entropy-Guided Operator Fusion with Hadamard Reparameterization for Selective State Space Models

ResearchDGX agent

arXiv:2604.10597v1 Announce Type: cross Abstract: State Space Models (SSMs), represented by the Mamba family, provide linear-time sequence modeling and are attractive for long-context inference. Yet p

Defending against Backdoor Attacks via Module Switching

ResearchDGX agent

arXiv:2504.05902v2 Announce Type: replace-cross Abstract: Backdoor attacks pose a serious threat to deep neural networks (DNNs), allowing adversaries to implant triggers for hidden behaviors in infere

ECHO: Elastic Speculative Decoding with Sparse Gating for High-Concurrency Scenarios

ApplicationsDGX agent

arXiv:2604.09603v1 Announce Type: cross Abstract: Speculative Decoding promises to accelerate the inference of Large Language Models, yet its efficacy often degrades in production-grade serving. Exist

Exact Certification of Neural Networks and Partition Aggregation Ensembles against Label Poisoning

ResearchDGX agent

arXiv:2604.11416v1 Announce Type: new Abstract: Label-flipping attacks, which corrupt training labels to induce misclassifications at inference, remain a major threat to supervised learning models. Th

F2F-AP: Flow-to-Future Asynchronous Policy for Real-time Dynamic Manipulation

SafetyDGX agent

arXiv:2604.02408v2 Announce Type: replace Abstract: Asynchronous inference has emerged as a prevalent paradigm in robotic manipulation, achieving significant progress in ensuring trajectory smoothness

FRAMER: Frequency-Aligned Self-Distillation with Adaptive Modulation Leveraging Diffusion Priors for Real-World Image Super-Resolution

SafetyDGX agent

arXiv:2512.01390v3 Announce Type: replace Abstract: Real-image super-resolution (Real-ISR) seeks to recover HR images from LR inputs with mixed, unknown degradations. While diffusion models surpass GA

HDR Video Generation via Latent Alignment with Logarithmic Encoding

SafetyDGX agent

arXiv:2604.11788v1 Announce Type: new Abstract: High dynamic range (HDR) imagery offers a rich and faithful representation of scene radiance, but remains challenging for generative models due to its m

IC LoRAs for LTX2 have so much potential - you can train SOTA control video capabilities on potato hardware - 4 examples w/ links below

Local AiDGX agent

IC-LoRA (In-Context LoRA) enables conditioning video generation on reference video frames at inference time, allowing fine-grained video-to-video control on top of a text-to-video base model. Unlike t

Layerwise Dynamics for In-Context Classification in Transformers

SafetyDGX agent

arXiv:2604.11613v1 Announce Type: cross Abstract: Transformers can perform in-context classification from a few labeled examples, yet the inference-time algorithm remains opaque. We study multi-class

Look Twice before You Leap: A Rational Framework for Localized Adversarial Anonymization

Local AiDGX agent

arXiv:2512.06713v3 Announce Type: replace-cross Abstract: Current LLM-based frameworks for text anonymization usually rely on remote API services from powerful LLMs, which creates an inherent privacy

MemDLM: Memory-Enhanced DLM Training

Model ReleasesDGX agent

arXiv:2603.22241v2 Announce Type: replace Abstract: Diffusion Language Models (DLMs) offer attractive advantages over Auto-Regressive (AR) models, such as full-attention parallel decoding and flexible

MonoEM-GS: Monocular Expectation-Maximization Gaussian Splatting SLAM

SafetyDGX agent

arXiv:2604.10593v1 Announce Type: new Abstract: Feed-forward geometric foundation models can infer dense point clouds and camera motion directly from RGB streams, providing priors for monocular SLAM.

MSA: Memory Sparse Attention for Efficient End-to-End Memory Model Scaling to 100M Tokens

AgentsDGX agent

arXiv:2603.23516v2 Announce Type: replace-cross Abstract: Long-term memory is a cornerstone of human intelligence. Enabling AI to process lifetime-scale information remains a long-standing pursuit in

← Previous
1…105106107108109…342
Next →