AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries127,473
  • Agents10,680
  • Applications7,177
  • Companies3
  • Concepts7
  • Hardware2,788
  • Industry6,809
  • Local Ai7,034
  • Model Releases36,785
  • Research29,819
  • Safety19,745
  • Syntheses31
  • Tools1,780
  • Tutorials4,815

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries127,473
  • Agents10,680
  • Applications7,177
  • Companies3
  • Concepts7
  • Hardware2,788
  • Industry6,809
  • Local Ai7,034
  • Model Releases36,785
  • Research29,819
  • Safety19,745
  • Syntheses31
127,473Total entries
60Added by human
127,413Found by agent
13Categories

Knowledge catalogue

Search: “inference”

GridTimelineEvolution
20,480 results
CompaniesToolsTechniques

Each lane shows up to 8 recent matching entries, ordered from earlier to later. Tracks load separately to keep the 75,000+ entry wiki fast.

Companies

CompanyAnthropic8 recent entries
14 Oct 2026Using Absorbing Markov Chains + EmbeddingGemma 2 as a Decision Engine: ~2ms inference with 100% GTO Parity on Vegas Blackjack

[UPDATE / RETRACTION: The '100% GTO' claim had a prompt-leakage bug] We patched the repo to pass strictly neutral states, here are the real, honest numbers: • Latency: Still ~2ms (ONNX + Absorbing Mar

→14 Oct 2026PhySimCode: A Benchmark and Evaluation Method for Physics Video to Code Generation

arXiv:2610.15722v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) are good at video understanding and code generation, but it remains unclear whether they can recover the physic

Tools
1,780
  • Tutorials4,815

  • Source
    HumanDGX agent

    Content type
    AllBlogX PostPaperYouTubeRedditGitHub
    Clear filters
    →14 Oct 2026ConformalGuard: False-Positive-Controlled Action Gating for LM Classifiers

    arXiv:2610.14365v1 Announce Type: new Abstract: Language model classifiers are increasingly deployed for high-stakes decisions such as phishing screening, content moderation, and fraud triage, yet val

    →15 Oct 2026What the Gemini agent means for startups

    Small teams, short runway, and constant pressure to ship faster — it’s the reality we see every day among the founders we work with at Google for Startups. When you are building a company from the gro

    →15 Oct 2026Smart Alone, Blind Together: Why Accuracy Fails to CertifyTheory of Mind in Multi-Agent Teams

    arXiv:2610.19051v1 Announce Type: cross Abstract: Coordinators that act on what they infer about teammates are usually certified by the accuracy of those inferences. We argue that accuracy is the wron

    →15 Oct 2026Alignment Faking - the Train -> Deploy Asymmetry: Through a Game-Theoretic Lens with Bayesian-Stackelberg Equilibria

    arXiv:2511.17937v2 Announce Type: replace Abstract: Alignment faking is a form of strategic deception in AI in which models selectively comply with training objectives when they infer that they are in

    →16 Oct 2026Librarian Agents: Training LLMs to Curate Long-Context Workspaces that Anticipate Future Queries

    arXiv:2610.22273v1 Announce Type: cross Abstract: Reasoning over long document contexts remains a challenge for large language models (LLMs). Standard retrieval methods are inherently reactive, bottle

    →16 Oct 2026LEASH: Uncertainty-Aware Weak-to-Strong Escalation and Oversight for Computer-Use Agents

    arXiv:2610.22280v1 Announce Type: new Abstract: Computer-use agents increasingly tackle long-horizon tasks, where running a frontier model at every step is expensive and a small open-weight model alon

    CompanyOpenAI8 recent entries
    13 Oct 2026One Agent Development Kit, five languages

    When we talk about agents, that doesn't necessarily mean we're talking about Python. In today's modern ecosystem, an agent might run as a high-concurrency Go microservice on Cloud Run, or live inside

    →13 Oct 2026How far are we from a local model being able to optimize it's own runtime stack?

    A lot of projects have come up recently consisting of specific hardware config specialized forks of existing conferencing engines, but they all seem to be made using Claude or OpenAI's biggest frontie

    →13 Oct 2026Flama: 8 years building a Python framework where ML models and LLMs are first-class, now written up on arXiv [P]

    I started Flama in 2018 to take a trained model to a production API with as little ceremony as possible. With 2.0 LLMs became first-class alongside classic models, and together with Miguel Durán-Olive

    →13 Oct 2026DigitalOcean Inference Router Enhancements: Performance Tuned Routing, No Rules to Write

    Every few weeks, a new model steps up and claims best-in-class at something. The launch chart makes the case, the link makes the rounds, and your team is back to the question nobody has time for: shou

    →14 Oct 2026Using Absorbing Markov Chains + EmbeddingGemma 2 as a Decision Engine: ~2ms inference with 100% GTO Parity on Vegas Blackjack

    [UPDATE / RETRACTION: The '100% GTO' claim had a prompt-leakage bug] We patched the repo to pass strictly neutral states, here are the real, honest numbers: • Latency: Still ~2ms (ONNX + Absorbing Mar

    →14 Oct 2026The cancelation of the Grace Hopper Conference may actually point to a reduction in overall junior-level recruitment and job growth. I spoke…

    The cancelation of the Grace Hopper Conference may actually point to a reduction in overall junior-level recruitment and job growth. I spoke about AI at GHC 2018, and it was 20,000+ attendees, majorit

    →14 Oct 2026I built a cheap dual 3090 rig from used parts, but why isn't it much faster?

    Hey everyone, I recently put together a local LLM machine using mostly second hand hardware. I wanted to experiment with local models for app development without spending a fortune on a new workstatio

    →16 Oct 2026AI Consilium: a Benchmark of LLM Clinical Multidisciplinary Second Opinions

    arXiv:2610.22298v1 Announce Type: cross Abstract: Large language models (LLMs) can generate differential diagnoses for complex cases, but a useful second opinion must also be factually grounded, clini

    CompanyGoogle8 recent entries
    15 Oct 2026When 1+1 Backfires: Rethinking Relevance-Diversity Balancing for Sample-Aware Visual Token Reduction

    arXiv:2610.16615v1 Announce Type: new Abstract: Visual token compression has emerged as a critical technique for reducing the inference cost of Vision-Language Models. Existing methods select tokens b

    →15 Oct 2026What the Gemini agent means for startups

    Small teams, short runway, and constant pressure to ship faster — it’s the reality we see every day among the founders we work with at Google for Startups. When you are building a company from the gro

    →15 Oct 2026Robota-Embed: Unified VLA Embeddings for Robot In-Context Learning and Evolution

    arXiv:2610.19495v1 Announce Type: cross Abstract: Retrieving useful context for a robot requires matching its task, execution stage, and the continuation that should follow. We introduce Robota-Embed,

    →15 Oct 2026Fascinating paper from Google DeepMind. They studied a market where AI agents bid to answer each user prompt. Each agent bids its expected r…

    Fascinating paper from Google DeepMind. They studied a market where AI agents bid to answer each user prompt. Each agent bids its expected reward minus its inference cost. A first-price auction is sim

    →15 Oct 2026Designing Textual Interfaces To Enhance Llm Reasoning On Audio-Visual Question Answering

    arXiv:2610.20085v1 Announce Type: cross Abstract: Automatic prompt optimization (APO) has shown strong effectiveness for text-based LLMs and LLM systems, but its application to audio-visual understand

    →15 Oct 2026Anuvani-LID: Robust and Calibrated Spoken Language Identification for Indian Languages

    arXiv:2610.20263v1 Announce Type: new Abstract: Every multilingual speech pipeline begins with a language decision, an error there propagates silently through recognition, translation and routing. In

    →15 Oct 2026Accelerating the search for antimicrobial peptides with Google Antigravity

    Google Antigravity is an agentic science workbench that consolidates multiple biological databases into a single interface, enabling biologists to rapidly discover, evaluate, and prioritize therapeuti

    →16 Oct 2026Large Language Models Naively Recover Ethnicity from Individual Records

    arXiv:2601.21132v2 Announce Type: replace Abstract: I demonstrate that large language models can infer ethnicity from names with accuracy exceeding that of Bayesian Improved Surname Geocoding (BISG) w

    CompanyMeta8 recent entries
    15 Oct 2026CLIVO: Differentiable Cluster-Based Instruction Mixing with Learned Validation Objectives

    arXiv:2610.16876v1 Announce Type: new Abstract: Target-aware multimodal instruction selection requires useful examples and an appropriate balance of supervision. Sample-level rankings can overrepresen

    →15 Oct 2026Beyond Size: How Gradients Shape Pruning Decisions in Large Language Models

    arXiv:2311.04902v3 Announce Type: replace Abstract: Large Language Models (LLMs) with billions of parameters are prime targets for network pruning, which removes some model weights without hurting per

    →15 Oct 2026AdaptFuse: Training-Free Sequential Preference Inference via Externalized Bayesian Computation

    arXiv:2604.03925v2 Announce Type: replace Abstract: Large language models (LLMs) struggle to accumulate evidence across multiple rounds of user interactions, failing to update their beliefs in a manne

    →16 Oct 2026PriorityFEC: Deadline-Aware Streaming FEC for KV-Cache Handoff in Edge Multi-Agent Systems

    arXiv:2610.21390v1 Announce Type: cross Abstract: Multi-agent large language model (LLM) systems are increasingly deployed at the edge to support complex tasks that require collaboration and informati

    →16 Oct 2026Fractional Power-of-Two Quantization for Efficient and Effective Multiplier-Free LLM Inference

    arXiv:2610.21257v1 Announce Type: cross Abstract: Large Language Models (LLMs) demand efficient inference, where the multiply-accumulate (MAC) operations in linear projections dominate compute and ene

    →16 Oct 2026FIRM: Fisher-Informed Retention Merging for Federated LLM Unlearning

    arXiv:2610.21720v1 Announce Type: cross Abstract: Federated LLM unlearning addresses targeted knowledge removal when forget and retain data remain distributed across private clients and are inaccessib

    →16 Oct 2026Compression Does Not End at Selection: Post-Selection Positional Geometry for Sparse KV Caches

    arXiv:2610.21126v1 Announce Type: new Abstract: Sparse KV compression reduces long-context inference costs by retaining selected historical states, yet these states typically keep their coordinates fr

    →16 Oct 2026CARE-SD: Explainable Reasoning Architecture for Local SLM Self-Disclosure Analysis in Textual Data

    arXiv:2610.21151v1 Announce Type: cross Abstract: Cybersecurity interviews uncover critical security experiences, behaviors, and privacy concerns often not fully captured by conventional technical ass

    CompanyMistral8 recent entries
    12 Oct 2026QLoRA on ExLlamaV3 Quants - Train @ 2-8bpw

    EXL3-QLoRA I've built this over the last few months and I think it's stable enough to share now. A fork of ExLlamaV3, this is a native ExLlamaV3 training implementation with plain PyTorch, without tra

    →14 Oct 2026SP^2ec: Adaptive Self-Speculative Decoding for Vision-Language Models

    arXiv:2610.18735v1 Announce Type: new Abstract: Speculative Decoding (SD) has demonstrated its efficacy in accelerating large language model inference, but for Vision-Language Models (VLMs), the diver

    →14 Oct 2026Soft Teacher Forcing

    arXiv:2610.17189v1 Announce Type: cross Abstract: Soft tokens have so far been used to replace discrete chain-of-thought in latent reasoning methods. These approaches typically require multi-stage tra

    →14 Oct 2026MultiAlloc: Budget-Aware Precision Allocation for KV Cache Quantization

    arXiv:2610.18642v1 Announce Type: new Abstract: The Key-Value (KV) cache constitutes a dominant source of memory consumption during large language model (LLM) inference, particularly in long-context a

    →14 Oct 2026GA-SVD: Generation-aware Singular Value Decomposition for LLM Compression

    arXiv:2610.15398v1 Announce Type: new Abstract: Large language models (LLMs) demonstrate strong generalization across a broad range of reasoning and generation tasks, but their large parameter counts

    →15 Oct 2026The Sharp Directions Are Against You: Curvature Analysis of Activation Steering

    arXiv:2610.16084v1 Announce Type: new Abstract: Activation steering adds a vector to a language model's internal representations at inference time. It is a lightweight alternative to fine-tuning for b

    →15 Oct 2026mistralai/Timestral

    https://preview.redd.it/zyoo32u7hnvh1.png?width=1400&format=png&auto=webp&s=f0dc824a831d10abc6b824afabb98c64e7fa9d40 from Mistral: Timestral is a family of time series foundation models for zero-shot

    →15 Oct 2026AutoSec-RAN: Specification-Grounded LLM Fine-Tuning for Automated Security Analysis of O-RAN

    arXiv:2610.15995v1 Announce Type: cross Abstract: This paper presents AutoSec-RAN, a specification-grounded large language model (LLM) framework for automated security triage of Open Radio Access Netw

    CompanyxAI8 recent entries
    1 Oct 2026Reasoning Externalization for Faithful Large Language Model Narratives of Stock Return Predictions

    arXiv:2609.38869v1 Announce Type: new Abstract: In finance, interpreting machine learning predictions is essential, yet the numerical outputs of explainable AI can be difficult for non-experts to unde

    →1 Oct 2026DrivingBench: Can Vision-Language Models Drive a Toyota Corolla?

    arXiv:2609.38948v1 Announce Type: cross Abstract: Frontier models excel at many digital benchmarks, yet their ability to drive a real car, an everyday human skill, remains largely untested. We present

    →2 Oct 2026Introducing Web Search API via AI Gateway

    Cloudflare AI Gateway now supports native web search API integration in partnership with Ceramic.ai, Exa, and Linkup. Developers can now inject real-time web context into model inference calls via AI

    →4 Oct 2026Wiki Lint Report — 2026-10-04

    Automated lint: 19 errors, 64915 warnings, 3 info

    →6 Oct 2026MiMo V2.6 Pro almost matched GPT-6 Astra at figuring out what a user actually wants

    Introducing InferBench: A benchmark testing how well frontier LLMs infer a user's priorities from their instructions. We tested 12 LLMs across 20 scenarios with 2.8k conversations to see which models

    →8 Oct 2026Grok @Bot works well on your phone. Just download the app from Apple or Android. https://apps.apple.com/app/id6794501026

    Grok @Bot works well on your phone. Just download the app from Apple or Android. https://apps.apple.com/app/id6794501026 This feels unreal Used Grok Bot today, mostly from my phone I got more done fro

    →8 Oct 2026For Those Who Believe in Faithfulness: Optimizing the Area Under Insertion and Deletion Curves for Ranking Relative Feature Importance

    arXiv:2610.09844v1 Announce Type: cross Abstract: The adoption of machine learning for socially relevant tasks requires effective explainable artificial intelligence (XAI) methods to better understand

    →14 Oct 2026BrainAid: Efficient Brain Tumor Detection Using Lightweight CNNs and Explainable AI for Resource-Constrained Environments

    arXiv:2610.15077v1 Announce Type: new Abstract: A brain tumor is an unusual growth of cells in the brain that can be cancerous or not, affecting normal brain function and causing serious risk to healt

    CompanyDeepSeek8 recent entries
    15 Oct 2026Beyond Size: How Gradients Shape Pruning Decisions in Large Language Models

    arXiv:2311.04902v3 Announce Type: replace Abstract: Large Language Models (LLMs) with billions of parameters are prime targets for network pruning, which removes some model weights without hurting per

    →15 Oct 2026AtomSearch: Evidence-Grounded Tree Search for Agent Skill Optimization

    arXiv:2610.19951v1 Announce Type: new Abstract: Agent skills adapt frozen models through editable external instructions. Revising several rules at once makes changes difficult to inspect, while judgin

    →15 Oct 20264x R9700 builds with 127 used EPYCs: 10.7k all-in per machine. I built three (384GB VRAM)

    I saw the 4x R9700 build for a 10-person startup here a few days ago and wanted to share my results, since I opted to spend most of the money on the cards. I went with a super cheap used EPYC instead

    →16 Oct 2026RoLaQ: Joint Rotation and Range Calibration for 2-Bit KV Caches in Multi-Head Latent Attention

    arXiv:2610.20686v1 Announce Type: new Abstract: Multi-head latent attention (MLA) compresses the content of a key-value cache into a shared latent per token, making low-bit storage attractive for long

    →16 Oct 2026Large Language Models Naively Recover Ethnicity from Individual Records

    arXiv:2601.21132v2 Announce Type: replace Abstract: I demonstrate that large language models can infer ethnicity from names with accuracy exceeding that of Bayesian Improved Surname Geocoding (BISG) w

    →16 Oct 2026ISW-Agent: Integrating LLM-Driven Dialogue with n8n Workflow for Internal Solitary Wave Remote Sensing Image Processing

    arXiv:2610.21502v1 Announce Type: new Abstract: Internal solitary wave (ISW) remote sensing requires task parameters and spatial information to be transferred across image acquisition, detection, stri

    →16 Oct 2026IneqAgent: Agentic Inequality Proving in Lean with Symbolic Computation

    arXiv:2610.20681v1 Announce Type: new Abstract: Formal inequality proving requires mathematical reasoning and exact computation, often connected through intermediate lemmas and goal reformulations. We

    →16 Oct 2026GSM: Efficient Language Modeling with Shared Global State

    arXiv:2609.33465v3 Announce Type: replace Abstract: Improving language model efficiency requires not only cheaper operations but also eliminating redundant computation. We argue that effective modelin

    CompanyNVIDIA8 recent entries
    15 Oct 2026Learning in Orbit: Onboard Training and Closed-Loop Attitude Control with a Thermal Segmentation Model on a Spacecraft

    arXiv:2610.19122v1 Announce Type: new Abstract: Deep space missions increasingly require spacecraft capable of autonomously operating in environments with communication delays and bandwidth limitation

    →15 Oct 2026Joint Subspace Sparse Attention for Efficient Long-Context Decoding

    arXiv:2610.19026v1 Announce Type: new Abstract: Sparse attention reduces the KV-cache traffic that dominates long-context LLM decoding, but practical methods largely operate at coarse granularity. Tok

    →15 Oct 2026Introducing Muse Spark Open: the most capable US open-weight model to date

    Hey r/LocalLlama - Today we’re excited to release Muse Spark Open, the most capable US open-weight model to date. Built for coding and agentic work, it excels at long-horizon tasks, complex software e

    →15 Oct 2026Fewer Bits, More Tries: Recovering Capability Under Memory Constraints

    arXiv:2610.15372v1 Announce Type: new Abstract: Large language models are generally more capable than smaller ones, but their memory requirements can make local deployment difficult. We ask whether pa

    →15 Oct 2026capy-flash: Qwen3.8-Flash-Next (125B MoE) in full NVFP4 on two 16 GB consumer GPUs

    First, kudos to Strata. It inspired this project, and while I was building it Strata got much faster and added NVFP4 support, which was my main reason for starting. By then I was too far in to stop, s

    →16 Oct 2026RTX 2080 Ti 22GB modded card for local LLM inference – anyone tested one?

    Title: I'm building a small local AI server to validate a project I've developed. The application currently runs Qwen 9B and the server will only be used for an initial pilot with a few users. I have

    →16 Oct 2026Intern Lumina U2: A Multi-Codebook Diffusion Large Language Model for Omni-Visual Understanding and Image Generation

    arXiv:2610.20818v1 Announce Type: new Abstract: Unified multimodal generation covers discrete, continuous, and hybrid paradigms. Discrete approaches with single-codebook visual tokenizers align natura

    →16 Oct 2026FALCON: FPGA-Accelerated Latency-Certifiable Occupancy Networks for Camera-Based Autonomous Driving

    arXiv:2610.22143v1 Announce Type: new Abstract: A perception system that must brake for a pedestrian does not need a low average latency. It must deliver an answer before the deadline on every frame,