hardware

PrefLUT: Reusable and Refinable Personalized Color Editing from Pairwise Preferences

arXiv:2609.34133v1 Announce Type: new Abstract: Photographic color editing is inherently personal: the same image can appear too warm, too muted, or already satisfactory to different users. Most looku

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Hardware

PulseInfer: I/O-Centric Sparse KV Cache Offloading for Efficient Long-Context LLM Decoding

DGX agent

arXiv:2609.34555v1 Announce Type: new Abstract: Long-context LLM serving is increasingly bottlenecked by decode, where large KV caches limit batch size and underutilize GPUs. Sparse KV cache offloadin

hardwarearxiv-cs-lg

29 Sept 2026

SANTA++: Sampling Attention through Representative Keys

arXiv:2609.35629v1 Announce Type: new Abstract: Attention often concentrates on a small subset of tokens in the context, but which subset matters changes from one query to the next. To exploit this ch

Scope-WM: Scoped Computation for Efficient Visual World Models

arXiv:2609.33218v1 Announce Type: new Abstract: Visual world models enable robotic planning by predicting future observations, but dense latent-state propagation and sample-intensive trajectory optimi

Single-Layer MeMo as a Randomized Hamming-Kernel Classifier

arXiv:2609.34562v1 Announce Type: new Abstract: MeMo (Zanzotto et al., 2025) is a recent language-model architecture that stores associations between token contexts and next tokens in a correlation ma

Sources: Nvidia is in early-stage talks with insurance companies to structure risk-mitigation products to protect lenders against loan defaults by neoclouds (Financial Times)

Financial Times: Sources: Nvidia is in early-stage talks with insurance companies to structure risk-mitigation products to protect lenders against loan defaults by neoclouds — World's largest listed c

SparSP: Exploiting Communication Sparsity for Sequence-Parallel Video DiTs

arXiv:2609.32197v1 Announce Type: cross Abstract: Diffusion Transformers have become the dominant architecture for video generation. Their substantial computational cost motivates scaling inference ac

Spexis: Speculative Lookahead Scheduling for LLM Inference

arXiv:2609.34370v1 Announce Type: new Abstract: Spexis is a multi-GPU LLM inference framework that improves the efficiency of pipeline and tensor parallelism through speculative parallelism. Rather th

STAMP: Predicting Out-of-Distribution Generalization without Target Data

arXiv:2609.32672v1 Announce Type: new Abstract: Predicting whether a trained model will generalize under distribution shift remains difficult, especially when target-domain data are unavailable. We in

Systematic Exploration of Multi-core Architectures for Efficient LLM Serving using WaferAI-SIM

arXiv:2510.05632v2 Announce Type: replace-cross Abstract: With the widespread adoption of Large Language Models (LLMs), the demand for high-performance LLM inference services continues to grow. Multi-

TempoKV: Timely Staging of LLM KV Caches for Memory-Semantic Flash

arXiv:2609.35065v1 Announce Type: cross Abstract: Reusable prefix key-value (KV) caches can outgrow GPU memory in large language model (LLM) serving. A memory-semantic flash hierarchy offers SSD-backe

Terrain-Aware Autonomous Planetary Exploration for Exteroceptive-Proprioceptive Mapping with Quadruped Scouts

arXiv:2609.35493v1 Announce Type: new Abstract: Autonomous planetary exploration requires robots to navigate unknown, uneven terrain while assessing risk, traversability, and energetic cost. Quadruped

hardwarearxiv-cs-ro

TopoEP: Topology-Aware Load Balancing for Expert-Parallel MoE Training

arXiv:2609.35481v1 Announce Type: cross Abstract: Dynamic routing creates severe load imbalance in large-scale expert-parallel Mixture-of-Experts (MoE) training, turning GPUs that host hot experts int

Towards Kinematic Actionable Infeasibility Detection in Motion Planning

arXiv:2609.32806v1 Announce Type: new Abstract: Motion planning in robotics requires not only computing collision-free paths but also certifying infeasibility when no such path exists. Complete method

hardwarearxiv-cs-ro

UnStep: Training-Free Acceleration of Causal Video Diffusion with Fewer Steps Than Distillation

arXiv:2609.32518v1 Announce Type: new Abstract: Distilling bidirectional multi-step video diffusion transformers into few-step causal models has become a common approach for streaming video generation

WorldAttention: An Efficient Attention Architecture for Interactive Video World Models

arXiv:2609.34606v1 Announce Type: new Abstract: Leveraging the paradigm of autoregressive diffusion, text-conditioned interactive video world models aim to simulate temporally coherent environments gu

AutoResearch at Production Scale: Failure Modes and a Multi-Agent Framework

arXiv:2609.30541v1 Announce Type: new Abstract: Optimizing embedding systems for production recommendation pipelines demands systematic exploration that consumes disproportionate engineering effort at

Compress What You See, Not What You Say: Anchored Context Distillation for Latent-Observation Software Engineering Agents

arXiv:2609.31430v1 Announce Type: new Abstract: Tool observations dominate the context of software-engineering agents, making long interaction histories costly to maintain. Existing context compressio

EAServe: Encode-Aware Disaggregated Serving for Multimodal Large Language Models

arXiv:2609.31551v1 Announce Type: cross Abstract: Disaggregating the two stages, Prefill and Decode, onto separate GPU pools is now a standard optimization for (text-only) LLM serving. However, multim

ENAS: An Efficient Hardware-Aware Neural Architecture Search Framework for TinyML on Resource-Constrained Microcontrollers

arXiv:2609.30272v1 Announce Type: cross Abstract: We present extbf{ENAS}, a hardware-aware Neural Architecture Search (NAS) framework that combines a static feasibility check, a cell-based search spac

every agent will need a sandbox and the harness should live outside it - separate the brains from the hands great to see nvidia open sourcin…

hardwareharrison-chase--x

every agent will need a sandbox and the harness should live outside it - separate the brains from the hands great to see nvidia open sourcing tools here, agree with Andrew this is part of the harness

FRESHLATENT: Channel-Aware Latent Adaptation for Resource-Constrained Embodied VLM Perception

arXiv:2609.30629v1 Announce Type: cross Abstract: Mission-critical UAVs increasingly rely on split vision-language model (VLM) perception under tight onboard-resource and wireless-communication constr

From Mono to Stereo: Accelerating Binocular Gaussian Splatting via Reprojection and Selective Patching

arXiv:2609.30741v1 Announce Type: new Abstract: Binocular rendering requires two nearby views of the same scene and therefore repeats substantial visibility and shading work. We present a 2D Gaussian

How NVIDIA DSX MaxLPS Maximizes AI Factory Throughput and Efficiency

NVIDIA’s DSX MaxLPS employs policy‑governed power sharing to dynamically reallocate power across GPU resources, enabling up to 40 % more GPUs within the same approved power budget. In a joint test at

hardwarenvidia-developer

I am concerned about all these disparate hard forks that target specific architectures instead of opening a PR against upstream

Other than the obvious self promotion, is there a practical reason people do this that I am missing? There's dozens of llamacpp forks with silly names that are supposedly 'optimized' for this or that

hardwarer-localllama

I-Parakeet: Integer-Only Conformer ASR on Mobile NPU

arXiv:2609.30846v1 Announce Type: new Abstract: In this paper, we propose I-Parakeet, an integer-only implementation of NVIDIA's Parakeet-CTC (0.6B parameters) that runs on a smartphone NPU without an

hardwarearxiv-cs-cl

Jensen Huang says AI model distillation is 'competition'; Scott Bessent described it as 'theft' in July and threatened sanctions against overseas companies (Kai Nicol-Schwarz/CNBC)

Kai Nicol-Schwarz / CNBC: Jensen Huang says AI model distillation is “competition”; Scott Bessent described it as “theft” in July and threatened sanctions against overseas companies — Watch CNBC's ful

KuaFu: Compressing Long User Behavior into Understanding at Billion Scale

arXiv:2609.31045v1 Announce Type: cross Abstract: Conversational agents, generative recommenders, and personalized advertising all rest on one capability: understanding each user from raw behavior. Pr

hardwarearxiv-cs-cl

MR. POP: Multi-Robot Parallel Optimizing Planner for Almost-Surely Asymptotically Optimal Planning

arXiv:2609.30644v1 Announce Type: new Abstract: Finding globally optimal paths remains a fundamental challenge in multi-robot motion planning. Despite acceleration of almost-surely asymptotically opti

hardwarearxiv-cs-ro

Nvidia increases its share buyback program by 150B, raising the remaining authorized amount to 235B, aiming to complete it through FY 2028; NVDA is up 20% YTD (Amy Thomson/Bloomberg)

Amy Thomson / Bloomberg: Nvidia increases its share buyback program by 150B, raising the remaining authorized amount to 235B, aiming to complete it through FY 2028; NVDA is up 20% YTD — Nvidia Corp.,

Physical AI chip startup SiMa.ai raised a 150M Series C led by Fidelity and Amplify at a 1.45B valuation, aiming to compete with Nvidia's CUDA-based hardware (Kyt Dotson/SiliconANGLE)

Kyt Dotson / SiliconANGLE: Physical AI chip startup SiMa.ai raised a 150M Series C led by Fidelity and Amplify at a 1.45B valuation, aiming to compete with Nvidia's CUDA-based hardware — Custom physic

Samsung commits 1B to AI infrastructure company Helix, adding to the 10B already secured when a KKR-led consortium including Nvidia established Helix in June (Wall Street Journal)

Wall Street Journal: Samsung commits 1B to AI infrastructure company Helix, adding to the 10B already secured when a KKR-led consortium including Nvidia established Helix in June — Helix expects to le

SAP and NVIDIA OpenShell: Working Toward Governance and Security for Auditable AI Agents in Enterprise Systems

SAP and NVIDIA’s OpenShell are partnering to develop governance, security, and audit‑ability frameworks for AI agents deployed within enterprise systems. This collaboration focuses on creating standar

hardwaresap-news

Scepsy: Serving Agentic Workflows Using Aggregate LLM Pipelines

arXiv:2604.15186v2 Announce Type: replace-cross Abstract: Agentic workflows carry out complex tasks by orchestrating multiple large language models (LLMs) and tools. Serving them at a target throughpu

Selective Amortization of Full-Budget Counterfactual Reasoning for Visual Token Communication

arXiv:2609.30756v1 Announce Type: new Abstract: Generative image communication transmits compact semantic tokens under a limited packet budget, where token selection directly affects the final reconst

Sources: OpenAI offered to invest ~100M in Hugging Face before Nvidia's 13B acquisition, but talks fell apart; AMD and Salesforce also held talks (Kate Rooney/CNBC)

Kate Rooney / CNBC: Sources: OpenAI offered to invest ~100M in Hugging Face before Nvidia's 13B acquisition, but talks fell apart; AMD and Salesforce also held talks — Before Nvidia agreed to pay roug

TRACKGRAPH: Online Open-Vocabulary 3D Scene Graphs via Image-Space Tracking

arXiv:2609.31005v1 Announce Type: new Abstract: Open-vocabulary 3D maps enable robots to reason about previously unknown environments using natural language. However, existing systems typically segmen

Universal Drift Correction for Multidimensional Scanning Microscopy

arXiv:2609.30866v1 Announce Type: cross Abstract: In scanning microscopy, drift causes the specimen to be sampled at positions displaced from the nominal probe positions. This displacement alters the

VkVIO: Cross-platform GPU Acceleration for Visual-Inertial Odometry with Vulkan

arXiv:2609.30459v1 Announce Type: cross Abstract: Perception in robotics and XR fundamentally relies on good state estimation. Visual-inertial odometry (VIO) and Simultaneous Localization and Mapping

We’re partnering with Nvidia and 100+ industry partners to build infrastructure that contains rogue AI agents. In this research, we gave 9 A…

We’re partnering with Nvidia and 100+ industry partners to build infrastructure that contains rogue AI agents. In this research, we gave 9 AI models root access inside SPACE and told them to break out

hardwareperplexity--x

What cracks me up is how for the last few weeks when @ZackKorman, @HeidyKhlaaf, @nathanhamiel and I (and many others) went on about how Open…

What cracks me up is how for the last few weeks when @ZackKorman, @HeidyKhlaaf, @nathanhamiel and I (and many others) went on about how OpenAI’s cybersecurity sucked and was the key immediate problem,

hardwaregary-marcus--x

Mentions of open models in latest US earnings calls surged 6x YoY, with open models hitting 56% of Vercel tokens in August and 40% of AT&T's AI workloads (Financial Times)

Financial Times: Mentions of open models in latest US earnings calls surged 6x YoY, with open models hitting 56% of Vercel tokens in August and 40% of AT&T's AI workloads — US businesses far beyond Si

27 Sept 2026

SpaceX's CFO says Starlink demand is unprecedented. The interesting part is who's driving it! Larry Goldberg @TeslaLarry breaks down the Gol…

SpaceX's CFO says Starlink demand is unprecedented. The interesting part is who's driving it! Larry Goldberg @TeslaLarry breaks down the Goldman conference interview. Bret Johnsen reiterated a coming

hardwareelon-musk--x

27 Sept 2026

AI data center builder Nscale raises $3.36B ahead of IPO

Nscale Ltd. today announced that it has secured 3.36 billion in funding to support its data center construction push. The capital will arrive in two tranches. Nscale expects to receive 2.26 billion in

hardwaresiliconangle

Are there still any hidden gem gpu's left?

you read about gpu's like the Tesla P40, V100, AMD M150 etc that people pick up for cheap. probably many others as well. Most are either server gpu's being phased out or mining discards, right? The pr

hardwarer-localllama

CoreWeave’s next test: From GPU scarcity to a durable AI cloud

Ahead of CoreWeave Inc.’s Fully Connected conference in San Francisco, we have made a notable investment in proprietary customer research with Qualitate. Rather than simply repeat the earnings call, w

hardwaresiliconangle

GLiNER2.5-Decide (DeBERTa-v3-large, 340M) converted to LiteRT: fp16 weights, answers identical to the official fp32 model on 361/361 test re…

GLiNER2.5-Decide (DeBERTa-v3-large, 340M) converted to LiteRT: fp16 weights, answers identical to the official fp32 model on 361/361 test requests, 66–70 ms per request on a Galaxy S26 GPU at 128 toke

hardwareclem-delangue--x

Let me get this straight. An AI agent found login credentials lying around online and used them to pull data from the Census Bureau. It trie…

Let me get this straight. An AI agent found login credentials lying around online and used them to pull data from the Census Bureau. It tried to break into the Education Department's civil rights offi

hardwaregary-marcus--x