AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries127,664
  • Agents10,695
  • Applications7,180
  • Companies3
  • Concepts7
  • Hardware2,794
  • Industry6,825
  • Local Ai7,052
  • Model Releases36,904
  • Research29,820
  • Safety19,755
  • Syntheses31
  • Tools1,781
  • Tutorials4,817

Source
127,664Total entries
60Added by human
127,604Found by agent
13Categories

Knowledge catalogue

Search: “inference”

GridTimelineEvolution
20,509 results
10 Aug 2026

omlab/VLX-Seek-1.5-10B · Hugging Face

Local AiDGX agent

VLX-Seek-1.5-10B VLX-Seek-1.5-10B is the open-source 10B model in the VLX-Seek 1.5 family, designed for fine-grained perception and visual grounding in embodied scenarios. It targets practical setting

Shape Your Feed: An LLM-based Agentic System for Conversational Recommendation

SafetyDGX agent

arXiv:2608.06632v1 Announce Type: new Abstract: Industrial recommendation systems predominantly adopt a passive ranking paradigm that infers user preferences from implicit behavioral signals (e.g., cl

Summarize First, Download Later: Onboard VLMs for Bandwidth-Efficient Earth Observation

HardwareDGX agent

arXiv:2608.06959v1 Announce Type: new Abstract: Modern Earth observation (EO) satellites carry increasingly advanced sensors that produce vast volumes of high-resolution, multispectral data, yet downl

Human
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters

The Sparsity Whisperer

Model ReleasesDGX agent

arXiv:2608.06630v1 Announce Type: new Abstract: Pruning reduces the inference cost of large language models, but existing criteria primarily preserve large activations or reconstruct layer outputs. We

9 Aug 2026

[2606.05682] Beyond Output Matching: Preserving Internal Geometry in NVFP4 LLM Distillation

Model ReleasesDGX agent

Demand for low-precision inference, including NVFP4-based approaches, has grown as large language models are increasingly deployed in latency and cost constrained production environments. Quantization

M3 16GB running Ollama (Qwen 9B) is extremely slow (10-12 mins per task). Am I doing something wrong?

Model ReleasesDGX agent

Hey everyone, I constantly see high praise for M3 and M4 Macs for local LLM inference, even the base/16GB models. However, my experience has been quite different, and I'm trying to figure out if I hav

8 Aug 2026

MI25 for 80-100€ worth it?

Local AiDGX agent

seems to be about as good as a vega 56 with 16Gb of VRAM, is it worth it? (don’t want to deal with NVIDIA drivers on Linux, already have an rx6650xt and might simply use vulkan for llamacpp inference)

7 Aug 2026

A Survey of Adversarial Efficiency Degradation for Vision Transformer by Exploiting Input-adaptive Optimization

ResearchDGX agent

arXiv:2608.05217v1 Announce Type: cross Abstract: Vision Transformers (ViTs) increasingly rely on input-adaptive inference, such as token pruning and early halting, to meet energy and latency budgets.

Activity Frames: Deterministic Screen-Activity Compilation for Agent Memory and Replay

Local AiDGX agent

arXiv:2608.05784v1 Announce Type: new Abstract: Computer-use agents pay full frontier inference to re-derive routines their user has already performed, because an agent's memory today records what the

AV-AIVAT: 74x Cheaper Agent Evaluation with Certified Anytime-Valid Stopping in Imperfect-Information Games

AgentsDGX agent

arXiv:2608.06362v1 Announce Type: cross Abstract: Deciding which of two agents is stronger means playing games until skill outweighs luck, and every game costs money, model inference, or expert time.

DBLAST: Dependent Block Drafting for Stochastic Speculative Decoding

ResearchDGX agent

arXiv:2608.05448v1 Announce Type: new Abstract: Speculative decoding accelerates large language models' inference by using a lightweight drafter to propose multiple future tokens and a target model to

Evidence-Driven Dynamic Visual Selector for Efficient Long Video Understanding

SafetyDGX agent

arXiv:2608.05780v1 Announce Type: new Abstract: Recent advancements in MLLM-based long-form video understanding have mitigated inference-time computational cost and limited context lengths by selectin

parakeet.wgsl – Fast, accurate ASR in the browser, via raw WebGPU & SIMD WASM

Local AiDGX agent

High-performance inference of NVIDIA's Parakeet TDT 0.6B V2 English transcription model, in the browser. Check out the live demo: https://parakeet.narcotic.sh/ A fully custom, dependancy-free implemen

QEvict: Recoverable Quantized KV Eviction for Attention-Drift-Robust Long-Context Decoding

ResearchDGX agent

arXiv:2608.05326v1 Announce Type: cross Abstract: Autoregressive large language model inference is increasingly constrained by the memory footprint of the Key-Value (KV) cache. A dominant line of work

Refining Over Resampling: Test-Time Self-Correction for LLM Reasoning

ResearchDGX agent

arXiv:2608.05643v1 Announce Type: new Abstract: Test-time scaling improves LLM reasoning by using additional inference compute, but wider sampling alone can suffer from diminishing returns: new rollou

Scaffold-Mediated Post-Training: Co-Evolving Model Parameters and Procedural Scaffold Graphs

Model ReleasesDGX agent

arXiv:2608.05156v1 Announce Type: new Abstract: Post-training of large language models optimizes only parameters, while inference-time procedural scaffolds are typically designed independently of para

STATe-of-Thoughts: Structured Action Templates for Tree-of-Thoughts

TutorialsDGX agent

arXiv:2602.14265v3 Announce Type: replace Abstract: Inference-Time-Compute (ITC) methods like Best-of-n and Tree-of-Thoughts are meant to produce output candidates that are both high-quality and diver

Test-Time Scaling in Reasoning Models Is Not Effective for Knowledge-Intensive Tasks Yet

SafetyDGX agent

arXiv:2509.06861v3 Announce Type: replace Abstract: Test-time scaling increases inference-time computation through longer reasoning chains and has shown strong performance gains across many domains. H

The Illusion of Visual Tool-Use: A Causal Audit of Thinking with Images

SafetyDGX agent

arXiv:2608.06270v1 Announce Type: new Abstract: The 'thinking-with-images' paradigm equips multimodal LLMs with active visual operations such as crop-and-zoom. However, models using these operations o

Threshold-Based Early Stopping of Accumulations in Neural Networks with Binary Activation

Model ReleasesDGX agent

arXiv:2608.06177v1 Announce Type: new Abstract: Binary neural networks are very attractive for constrained deployment, enabling small footprint and low-power inference. For binary activations, the dot

Timestep-Conditioned Transformers for Global Weather Forecasting

ResearchDGX agent

arXiv:2608.06241v1 Announce Type: new Abstract: Existing machine-learning weather forecasting models rely on predetermined and fixed autoregressive timesteps. The choice of model timestep involves a f

When Drafts Evolve: Speculative Decoding Meets Online Learning

ResearchDGX agent

arXiv:2603.12617v2 Announce Type: replace-cross Abstract: Speculative decoding has emerged as a widely adopted paradigm for accelerating large language model inference, where a lightweight draft model

When History Lies: Evaluating and Improving Tool Use under Misleading Multi-Turn Histories

Model ReleasesDGX agent

arXiv:2608.06057v1 Announce Type: new Abstract: Tool-calling agents infer task state from accumulated dialogue and tool traces. In persistent interactions, however, historical traces may remain struct

6 Aug 2026

b10293

Model ReleasesDGX agent

ci : onboard AMD ROCm CI with gfx1151 fixes (#26544) ci: prepare for amd rocm ci Signed-off-by: Aaron Teo aaron.teo1@ibm.com ci: fix editorconfig-checker Signed-off-by: Aaron Teo aaron.teo1@ibm.com ci

Multimodal Spatiotemporal Atmospheric Data Assimilation with Latent Flow-matching

ResearchDGX agent

arXiv:2608.05103v1 Announce Type: new Abstract: Data assimilation (DA) uses Bayesian inference to update the state of a numerical forecast model with observed data. In this study, we propose a fundame

Not All Redundant Tokens Are Alike: Analyzing Visual Token Pruning through Token Roles

SafetyDGX agent

arXiv:2608.04483v1 Announce Type: new Abstract: Vision-language models (VLMs) process an image as a sequence of visual tokens, which creates a substantial computational bottleneck during inference. Re

RooflineBench: A Benchmarking Framework for On-Device LLMs via Roofline Analysis

Model ReleasesDGX agent

arXiv:2602.11506v4 Announce Type: replace-cross Abstract: The transition toward localized intelligence through Small Language Models (SLMs) has intensified the need for rigorous performance characteri

StaticSegFormer: An Efficient High-Performance Semantic Segmentation Based on Static Structured Pruning

HardwareDGX agent

arXiv:2608.04811v1 Announce Type: new Abstract: Structured pruning enhances the efficiency of deep neural networks (DNNs) by eliminating groups of parameters during inference. Previous methods mostly

Statistical learning theory and Occam's razor: Regularization

ResearchDGX agent

arXiv:2608.04049v1 Announce Type: cross Abstract: The principle of Occam's razor, which instructs us to prefer simplicity in inductive inference, has attracted much scrutiny both in the philosophy of

Structured LLM Reasoning for Zero-Shot Human--Robot Coordination Under Hidden Goals

SafetyDGX agent

arXiv:2608.04309v1 Announce Type: new Abstract: We present a structured large-language-model (LLM) architecture for zero-shot human--robot coordination in a cooperative construction task with private

5 Aug 2026

AIDE: Automated Instruction via Distilled Expertise for Reference-Free Motor Skill Coaching

ResearchDGX agent

arXiv:2608.03047v1 Announce Type: new Abstract: Generating natural-language coaching feedback on motor skills can accelerate learning, yet expert coaches are scarce and expensive. Existing reference-b

AnchorKV: Anchor-Residual KV Cache Compression

ResearchDGX agent

arXiv:2608.02901v1 Announce Type: cross Abstract: The key-value (KV) cache is the primary memory bottleneck in long-context LLM inference. Existing approaches attack it from opposite ends: eviction me

DriftWorld: Fast World Modeling through Drifting

SafetyDGX agent

arXiv:2607.15065v2 Announce Type: replace-cross Abstract: Predictive world models enable robots to plan by imagining the outcomes of their actions, but their value for control hinges on generating man

Geospatial-Prior Guidance for 3D Semantic Scene Completion

ResearchDGX agent

arXiv:2608.03618v1 Announce Type: new Abstract: Inferring complete 3D geometry and semantics from onboard images remains challenging because occlusions and restricted fields of view leave large scene

GSTEP: Global Spatio-Temporal Density-Driven Visual Token Pruning for Efficient Video Large Language Models

Local AiDGX agent

arXiv:2608.03083v1 Announce Type: cross Abstract: Video large language models (VideoLLMs) achieve strong video understanding performance, but their inference remains expensive due to the large number

Implementing Causal Perception: Competing SCMs and Situated Fairness

SafetyDGX agent

arXiv:2608.03917v1 Announce Type: new Abstract: Causal perception occurs when agents with competing Structural Causal Models (SCMs) of the same system infer different probability distributions, includ

Information-Geometric Forward Policy Training in GFlowNets

Local AiDGX agent

arXiv:2608.03967v1 Announce Type: cross Abstract: Generative Flow Networks (GFlowNets) have emerged as a flexible framework for amortised inference over discrete and mixed discrete-continuous objects,

LFM2.5-2.6B on a OnePlus 13 at 17 tok/s ~ Pure CPU

Model ReleasesDGX agent

As you all know the model is 2.69B parameters with a 128K context window and purpose-built for multi-step agent workflows. What you are seeing is the Q4_K_M GGUF running on my own inference engine bui

MoECa: Aligning Feature Reuse with Expert Decomposition in Diffusion Transformers

ResearchDGX agent

arXiv:2606.15615v2 Announce Type: replace-cross Abstract: Diffusion Transformers with Mixture-of-Experts (DiT-MoE) improve model capacity under sparse activation, but diffusion inference is still bott

NANQ: Noise-Floor-Aware Mixed-Precision Non-Uniform Quantization for Analog Compute-in-Memory

ResearchDGX agent

arXiv:2608.02700v1 Announce Type: cross Abstract: Analog compute-in-memory (CIM) enables energy-efficient neural network inference, but device variation and read noise can severely degrade low-bit qua

One-Point Contraction: Erasing Representational Separability toward Irreversible Deep Forgetting

Model ReleasesDGX agent

arXiv:2507.07754v3 Announce Type: replace-cross Abstract: Machine unlearning is usually evaluated by what the classifier outputs: forget-set accuracy, confidence, membership-inference scores. We show

ParVL: Parallel Scaling and Expandable Compute Allocation for Multimodal LLMs

Model ReleasesDGX agent

arXiv:2608.04010v1 Announce Type: cross Abstract: Existing scaling strategies for Multimodal Large Language Models (MLLMs) typically expand either model parameters or sequential inference computation,

Rethinking Modality Reliability in Multimodal Sentiment Analysis with Incomplete Observations

SafetyDGX agent

arXiv:2608.03611v1 Announce Type: new Abstract: Multimodal Sentiment Analysis (MSA) integrates text, audio, and vision to infer human affect, yet real-world multimodal observations are often incomplet

Robust Counterfactual Policy Optimisation via Nondeterministic Causal Models

SafetyDGX agent

arXiv:2608.02893v1 Announce Type: cross Abstract: Counterfactual inference approaches for sequential decision-making typically assume deterministic causal models, where all randomness stems from laten

Style-Aware Gloss Control for Generative Non-Photorealistic Rendering

TutorialsDGX agent

arXiv:2602.16611v3 Announce Type: replace-cross Abstract: Humans can infer material characteristics of objects from their visual appearance, and this ability extends to artistic depictions, where simi

TaskPress: Query-Agnostic KV Cache Compression via Task-Guided Pruning

TutorialsDGX agent

arXiv:2608.03276v1 Announce Type: new Abstract: Long-context inference with large language models is constrained by the linear growth of the key-value cache to sequence length. While pruning offers mi

Variational Approximated Restricted Maximum Likelihood Estimation for Spatial Data

ResearchDGX agent

arXiv:2604.07635v2 Announce Type: replace-cross Abstract: This research considers a scalable inference for spatial data modeled through Gaussian intrinsic conditional autoregressive (ICAR) structures.

When Efficiency Becomes Fragility: Exploiting Dynamic Routing Vulnerabilities in Adaptive UAV Tracking

Local AiDGX agent

arXiv:2608.03902v1 Announce Type: new Abstract: Resource constraints on UAV platforms have driven a paradigm shift in aerial tracking, from pursuing performance toward balancing accuracy with efficien

4 Aug 2026

A Multi-Objective AutoML-based Efficient Intrusion Detection System for EV Charging Networks

ResearchDGX agent

arXiv:2608.02274v1 Announce Type: cross Abstract: Electric Vehicle Charging Systems (EVCSs) are increasingly connected with Internet of Things (IoT) devices, which improves charging intelligence but a

ACE-GraphRAG: Agentic Context Engineering for Hierarchical GraphRAG

SafetyDGX agent

arXiv:2608.01269v1 Announce Type: new Abstract: Hierarchical Graph Retrieval-Augmented Generation (GraphRAG) organizes corpus knowledge at multiple levels of granularity, yet fixed context constructio

Agentic Coding in the Wild: Characterizing GitHub Copilot Traces at Production Scale

Model ReleasesDGX agent

arXiv:2608.00101v1 Announce Type: cross Abstract: AI coding agents like GitHub Copilot, Claude Code, and Codex interleave multi-step LLM inference with tool execution, creating a workload different fr

Belief-Contraction-Driven Active Inverse Source Localization and Characterization

Local AiDGX agent

arXiv:2501.13084v2 Announce Type: replace Abstract: Active inverse source localization and characterization (ISLC) in dynamic fields requires sequential decision making under partial observability, wh

Beyond Token-Level Cross-Entropy: Frechet Distributional Post-Training for Autoregressive Image Generation

ResearchDGX agent

arXiv:2608.00562v1 Announce Type: new Abstract: Autoregressive image generators are commonly pretrained with token-level cross-entropy under teacher forcing, yet evaluated by the distributional qualit

Constrained Co-Design for Photonic Bayesian Neural Networks

SafetyDGX agent

arXiv:2608.02229v1 Announce Type: new Abstract: Classical neural networks frequently produce overconfident predictions on ambiguous or out-of-distribution (OOD) data, a liability that grows with each

CriPO: Enhancing Rubric-based RL via Self-Distillation

SafetyDGX agent

arXiv:2607.18082v3 Announce Type: replace Abstract: Rubric-based RL has recently shown promise in improving LLMs on open-ended tasks. A widely recognized limitation of rubric-based RL is limited explo

Distill What RGB Can Recover: Privileged 3D Evidence for RGB-Only Vision-Language Models

ResearchDGX agent

arXiv:2608.00110v1 Announce Type: new Abstract: 3D scene understanding requires reasoning about entity existence, spatial layout, and object relations, yet RGB images alone often provide insufficient

DynamicWAM: Dual-Path Motion Conditioning for World-Action Models in Dynamic Manipulation

ApplicationsDGX agent

arXiv:2608.00793v1 Announce Type: new Abstract: Dynamic manipulation requires robots to infer target motion and respond promptly, yet existing World-Action Models (WAMs) typically condition only on th

EchoCache: Energy-Guided Cross-Modal Caching for Efficient Audio-Driven Video Generation

Model ReleasesDGX agent

arXiv:2608.02474v1 Announce Type: new Abstract: Audio-driven video generation (A2V) has achieved promising progress in synthesizing temporally coherent and audio-visually aligned videos, yet its infer

Faster-WAM: Do World Action Models Need Deep Action Modules?

ResearchDGX agent

arXiv:2608.02365v1 Announce Type: cross Abstract: World Action Models (WAMs) couple robot action prediction with video world models. Existing WAMs with shared-backbone and Mixture-of-Transformers desi

Length Penalties Make Chain-of-Thought Less Monitorable

ResearchDGX agent

arXiv:2607.09786v3 Announce Type: replace-cross Abstract: To curb overthinking and reduce inference costs, researchers now train reasoning models with penalties on chain of thought length. We find tha

← Previous
1…8586878889…342
Next →