Search: “hardware”

Stream2LLM: Overlap Context Streaming and Prefill for Reduced Time-to-First-Token (TTFT)

arXiv:2604.16395v2 Announce Type: replace-cross Abstract: Context retrieval systems for LLM inference face a critical challenge: high retrieval latency creates a fundamental tension between waiting fo

24 Apr 2026

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Hardware

BatchLLM: Optimizing Large Batched LLM Inference with Global Prefix Sharing and Throughput-oriented Token Batching

DGX agent

arXiv:2412.03594v3 Announce Type: replace-cross Abstract: Large language models (LLMs) increasingly play an important role in a wide range of information processing and management tasks in industry. M

hardwarearxiv-cs-ai

23 Apr 2026

Model Releases

Last night was the biggest disaster in the history of Tesla. Let me walk you through what actually happened on that earnings call, because t…

model-releasesgary-marcus--x

Last night was the biggest disaster in the history of Tesla. Let me walk you through what actually happened on that earnings call, because the headlines are doing you a disservice: Elon Musk got on th

23 Apr 2026

Stream-CQSA: Avoiding Out-of-Memory in Attention Computation via Flexible Workload Scheduling

arXiv:2604.20819v1 Announce Type: new Abstract: The scalability of long-context large language models is fundamentally limited by the quadratic memory cost of exact self-attention, which often leads t

23 Apr 2026

ARGUS: Agentic GPU Optimization Guided by Data-Flow Invariants

arXiv:2604.18616v1 Announce Type: cross Abstract: LLM-based coding agents can generate functionally correct GPU kernels, yet their performance remains far below hand-optimized libraries on critical co

22 Apr 2026

From Rainforests to Recycling Plants: 5 Ways NVIDIA AI Is Protecting the Planet

NVIDIA AI and accelerated computing are advancing sustainability, climate science and energy efficiency through five key applications. These include RecycleOS, an AI and robotics solution that helps r

hardwarenvidia-blog

22 Apr 2026

Condense, Don't Just Prune: Enhancing Efficiency and Performance in MoE Layer Pruning

arXiv:2412.00069v3 Announce Type: replace-cross Abstract: Mixture-of-Experts (MoE) has garnered significant attention for its ability to scale up neural networks while utilizing the same or even fewer

Enabling AI ASICs for Zero Knowledge Proof

arXiv:2604.17808v1 Announce Type: cross Abstract: Zero-knowledge proof (ZKP) provers remain costly because multi-scalar multiplication (MSM) and number-theoretic transforms (NTTs) dominate runtime as

Model Releases

MerLin: A Discovery Engine for Photonic and Hybrid Quantum Machine Learning

model-releasesarxiv-cs-lg

arXiv:2602.11092v2 Announce Type: replace Abstract: Identifying where quantum models may offer practical benefits in near term quantum machine learning (QML) requires moving beyond isolated algorithmi

RACE Attention: A Strictly Linear-Time Attention Layer for Training on Outrageously Large Contexts

arXiv:2510.04008v5 Announce Type: replace Abstract: Softmax Attention has a quadratic time complexity in sequence length, which becomes prohibitive to run at long contexts, even with highly optimized

Scalable and Adaptive Parallel Training of Graph Transformer on Large Graphs

arXiv:2604.16715v1 Announce Type: cross Abstract: Graph foundation models have demonstrated remarkable adaptability across diverse downstream tasks through large-scale pretraining on graphs. However,

Towards Real-Time ECG and EMG Modeling on mu NPUs

arXiv:2604.18067v1 Announce Type: new Abstract: The miniaturisation of neural processing units (NPUs) and other low-power accelerators has enabled their integration into microcontroller-scale wearable

researcharxiv-cs-lg

Web-Gewu: A Browser-Based Interactive Playground for Robot Reinforcement Learning

arXiv:2604.17050v1 Announce Type: new Abstract: With the rapid development of embodied intelligence, robotics education faces a dual challenge: high computational barriers and cumbersome environment c

hardwarearxiv-cs-ro

Closing the Theory-Practice Gap in Spiking Transformers via Effective Dimension

arXiv:2604.15769v1 Announce Type: cross Abstract: Spiking transformers achieve competitive accuracy with conventional transformers while offering 38-57imes energy efficiency on neuromorphic hardware,

researcharxiv-cs-ai

20 Apr 2026

Scalable Posterior Uncertainty for Flexible Density-Based Clustering

arXiv:2603.03188v2 Announce Type: replace-cross Abstract: We introduce a novel framework for uncertainty quantification in clustering that combines martingale posterior distributions with density-base

20 Apr 2026

We’re launching Kimi K2.6 on Fireworks as a Day-0 launch partner! K2.5 was the base for standout models like @Cursor’s Composer 2 and was th…

We’re launching Kimi K2.6 on Fireworks as a Day-0 launch partner! K2.5 was the base for standout models like @Cursor’s Composer 2 and was the most popular model on our training platform. K2.6 on Firew

hardwarefireworks-ai--x

20 Apr 2026

From Natural Language to PromQL: A Catalog-Driven Framework with Dynamic Temporal Resolution for Cloud-Native Observability

arXiv:2604.13048v1 Announce Type: cross Abstract: Modern cloud-native platforms expose thousands of time series metrics through systems like Prometheus, yet formulating correct queries in domain-speci

17 Apr 2026

Reference-Free Sampling-Based Model Predictive Control

arXiv:2511.19204v3 Announce Type: replace Abstract: We present a sampling-based model predictive control (MPC) framework that enables emergent locomotion without relying on handcrafted gait patterns o

hardwarearxiv-cs-ro

17 Apr 2026

The Multi-GPU Era: Why Heterogeneous Compute Is Becoming Enterprise Standard

Heterogeneous computing, which combines multiple types of GPUs and processors, is becoming standard in enterprise environments to handle diverse workloads more efficiently than traditional homogeneous

hardwarevultr

16 Apr 2026

Local Ai

Cline with Ollama on a RTX4090 (24GRAM) and i9 with 64 GRAM

This Reddit post from r/ollama discusses a user's experience running Cline (an AI coding agent) with Ollama on a high-end local hardware setup consisting of an NVIDIA RTX 4090 with 24GB VRAM and an In

local-air-ollama

Roop Unleashed 4.3.1 not fully utilizing RTX 5070 Ti / 5080X (Low GPU/RAM usage)

hardwarer-stablediffusion

This Reddit thread from r/StableDiffusion discusses a performance issue where Roop Unleashed version 4.3.1 — a face-swapping tool commonly used alongside Stable Diffusion — fails to fully utilize the

Local Ai

Running a 31B model locally made me realize how insane LLM infra actually is

A Reddit post from r/ollama in which a user shares their experience running a 31B parameter model locally using Ollama, reflecting on the surprisingly demanding hardware and infrastructure requirement

local-air-ollama

🆕 The Full Story of Notion AI https://latent.space/p/notion We're so excited to chat with @simonlast and @sarahmsachs about Notion's 'Token…

🆕 The Full Story of Notion AI https://latent.space/p/notion We're so excited to chat with @simonlast and @sarahmsachs about Notion's 'Token Town' - the crack team of AI Engineers and Model Behavior En

hardwareswyx--x

CUTEv2: Unified and Configurable Matrix Extension for Diverse CPU Architectures with Minimal Design Overhead

arXiv:2604.11615v1 Announce Type: cross Abstract: Matrix extensions have emerged as an essential feature in modern CPUs to address the surging demands of AI workloads. However, existing designs often

researcharxiv-cs-ai

Safety

Device-Conditioned Neural Architecture Search for Efficient Robotic Manipulation

arXiv:2604.10170v1 Announce Type: cross Abstract: The growing complexity of visuomotor policies poses significant challenges for deployment with heterogeneous robotic hardware constraints. However, mo

safetyarxiv-cs-cv

IceCache: Memory-efficient KV-cache Management for Long-Sequence LLMs

arXiv:2604.10539v1 Announce Type: cross Abstract: Key-Value (KV) cache plays a crucial role in accelerating inference in large language models (LLMs) by storing intermediate attention states and avoid

NVIDIA Ising Introduces AI-Powered Workflows to Build Fault-Tolerant Quantum Systems

NVIDIA Ising is the world's first family of open-source quantum AI models, designed to help researchers and enterprises build quantum processors capable of running useful applications. The family span

SCNO: Spiking Compositional Neural Operator -- Towards a Neuromorphic Foundation Model for Nuclear PDE Solving

arXiv:2604.11625v1 Announce Type: cross Abstract: Neural operators have emerged as powerful surrogates for partial differential equation (PDE) solvers, yet they are typically trained as monolithic mod

Tessera: Unlocking Heterogeneous GPUs through Kernel-Granularity Disaggregation

arXiv:2604.10180v1 Announce Type: cross Abstract: Disaggregation maps parts of an AI workload to different types of GPUs, offering a path to utilize modern heterogeneous GPU clusters. However, existin

Vestibular reservoir computing

arXiv:2604.09943v1 Announce Type: new Abstract: Reservoir computing (RC) is a computational framework known for its training efficiency, making it ideal for physical hardware implementations. However,

researcharxiv-cs-lg

what's the best place to buy GPU server?

This Reddit thread from r/ollama discusses community recommendations for purchasing or renting GPU servers to run Ollama and local LLMs. It likely covers options ranging from dedicated GPU server prov

hardwarer-ollama

$200/month is enough to buy an H100 GPU for 6 hours every workday

hardwaresoumith-chintala--x

Soumith Chintala shared a post highlighting that $200 per month is sufficient to rent access to an NVIDIA H100 GPU for approximately 6 hours every workday, making high-end AI compute more accessible t

13 Apr 2026

Concepts

All Models

Auto-generated index of all models mentioned across the wiki.

conceptsmodelsindex

11 Apr 2026

🫡 @aiDotEngineer in London was extremely good. Absolutely incredible speaker line up, great curation, escaped the Silicon Valley bubble mas…

"**AI Engineer Europe (London) — Conference Recap**

hardwareswyx--x

10 Apr 2026

Behind the Analysis with Google Cloud and Team USA: Architecting AI infrastructure for U.S. Winter Olympians

In freeskiing and snowboarding, traditional video replay shows you what happened during a complex aerial maneuver, but it fails to explain the physics of how it was possible. At the speed of the sport

hardwaregoogle-cloud-ai

10 Apr 2026

That’s a wrap on HumanX. Custom comics, hats, a happy hour with @getmetronome & @nvidia, and two sessions on what actually matters for AI-na…

Together Computer (Together AI) participated in HumanX 2026, a major AI conference held April 6–9 in San Francisco, where they hosted activations including custom comics, branded hats, and a happy ...

hardwaretogether-ai--x

10 Apr 2026

Cut Checkpoint Costs with About 30 Lines of Python and NVIDIA nvCOMP

Training LLMs requires periodic checkpoints — full snapshots of model weights, optimizer states, and gradients — whose storage costs can reach $200,000/month for a 405B model on 128 NVIDIA DGX B200...

9 Apr 2026

How to Accelerate Protein Structure Prediction at Proteome-Scale

NVIDIA, Google DeepMind, EMBL-EBI, and Seoul National University collaborated to extend the AlphaFold Protein Structure Database (AFDB) beyond monomeric structures to proteome-scale quaternary stru...

9 Apr 2026

Running Large-Scale GPU Workloads on Kubernetes with Slurm

NVIDIA's open-source project **Slinky** (developed by SchedMD, now part of NVIDIA) enables organizations to run full Slurm clusters directly on Kubernetes infrastructure by managing the complete li...

9 Apr 2026

Integrate Physical AI Capabilities into Existing Apps with NVIDIA Omniverse Libraries

NVIDIA has introduced a modular, library-based architecture for Omniverse, exposing core components—RTX rendering, PhysX-based simulation, and data storage pipelines—as standalone, headless-first C...

8 Apr 2026

New Vultr Identity and Access Management Upgrades

Vultr has upgraded its Identity and Access Management (IAM) framework by replacing legacy ACLs with fine-grained, policy-driven access controls, enabling organizations to assign roles, manage permi...

hardwarevultr

8 Apr 2026

NVIDIA’s New AI Just Changed Everything

hardwaretwo-minute-papers

I was unable to directly access the YouTube video at the provided URL, and my search did not return results specifically identifying that video's content. YouTube videos cannot be fetched or read a...

7 Apr 2026

AdaRSI: On-Demand Recursive Self-Improvement for Embodied Agents

arXiv:2610.20474v1 Announce Type: new Abstract: Pretrained vision-language-action models (VLAs) often fail midway through unseen long-horizon tasks. Recursive self-improvement (RSI) offers a remedy, b

AgriJev: Efficient Agricultural Candidate Scoring with Multi-Scale Adapted Models

arXiv:2610.19478v1 Announce Type: new Abstract: Agricultural systems make decisions over heterogeneous entity types, textual judgments, and knowledge-question options. Generating a textual answer adds

AReaL-RSI: Adaptive Scaling and Coordination of Recursive Self-Improvement

arXiv:2610.18083v1 Announce Type: new Abstract: Scaling recursive self-improvement requires additional computation to produce useful research progress in reaching persistent objectives. Intuitively, m

Continuum Attention

arXiv:2610.20586v1 Announce Type: new Abstract: We introduce Continuum Attention (CA), a causal Transformer attention operator that replaces discrete key and value lookup with integration over a conti

DEEPRUBRIC: Evidence-Tree Rubric Supervision for Efficient Reinforcement Learning of Deep Research Agents

arXiv:2606.17029v2 Announce Type: replace Abstract: Deep research agents synthesize long-form reports by searching and reasoning over retrieved evidence. Reinforcement learning with rubric-based rewar

Early days of OpenAI

Early days of OpenAI Jensen Huang once admitted that when NVIDIA unveiled its first AI supercomputer, nobody wanted it. Not a single purchase order. Except for Elon Musk. 'He goes, 'You know what? I h

hardwareelon-musk--x