hardware

MINCE: Shrinking LLM Evaluation Datasets via Few-Model Monte Carlo Calibration

arXiv:2606.22826v2 Announce Type: replace Abstract: Evaluating LLMs across many model variants---quantized, fine-tuned, or deployment-specific---requires running large benchmarks repeatedly, a process

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Hardware

ORBIT-FMIB: Tracking Order-Resolved Epistatic Information Through ESM-2

DGX agent

arXiv:2610.00672v1 Announce Type: new Abstract: Protein foundation models support mutation-effect and structural prediction, but predictive performance alone does not reveal which forms of biological

hardwarearxiv-cs-lg

2 Oct 2026

Qwen3.8-Flash-Next (5.05bpw + ngram at bf16) exl3 on one r9700: 863 t/s prefill and 35 t/s decode at 230k context (256k max), is that ok or am i missing something?

Hi, i got QFN running on my single r9700 but im not sure if i did everything right to get the best quality and speed out of this setup. Dont want to annoy anybody, maybe someone with the same card can

hardwarer-localllama

TensorCommitments: A Lightweight Verifiable Inference for Language Models

arXiv:2602.12630v2 Announce Type: replace-cross Abstract: Most large language models (LLMs) run on external clouds: users send a prompt, pay for inference, and must trust that the remote GPU executes

The Comfy Dev Platform Challenge is open! Partners: @ltx_io & @bfl_ai For two weeks (10/5–10/19), we're challenging the community to open-so…

The Comfy Dev Platform Challenge is open! Partners: @ltx_io & @bfl_ai For two weeks (10/5–10/19), we're challenging the community to open-source a paid AI feature. 🏆 $10K grand prize 🖥️ 3x NVIDIA RTX

hardwarecomfyui--x

Towards Automatic Video Annotation with ASH: Zero-Shot Open-Vocabulary Multi-Object Tracking and Segmentation

arXiv:2610.01022v1 Announce Type: new Abstract: Memory-attention-based Video Instance Segmentation (VIS) methods have demonstrated strong zero-shot tracking capability, yet their substantial memory re

Training-Free Diffusion Planning with Analytical Local Scores

arXiv:2610.01959v1 Announce Type: cross Abstract: Path finding and multi-robot motion planning require trajectories that are smooth, goal-directed, and collision-free in environments with complex geom

Wiring and powering GPUs differently can swing AI latency by orders of magnitude, says CoreWeave

The neocloud market is moving past its origins as a stopgap for scarce graphics processing units. AI-native startups now choose their infrastructure on latency, burst capacity and openness, not just c

A Pre-trained Variational Autoencoder for Gyrokinetic Plasma Turbulence Surrogate Modeling

arXiv:2609.38438v1 Announce Type: cross Abstract: Machine learning surrogate models offer a promising path toward accelerating plasma turbulence simulations. We present PreVAE-Turb, a surrogate modeli

Bongard: Training Machine Intuition

arXiv:2609.39111v1 Announce Type: new Abstract: Human intelligence relies heavily on learned intuition: recognising patterns and judging situations without explicitly unfolding every intermediate step

hardwarearxiv-cs-cl

Build agent memory with NVIDIA NeMo Agent Toolkit and Amazon S3 Vectors

Learn how to use Amazon S3 Vectors as the persistent memory layer within the NVIDIA NeMo Agent Toolkit (NAT), deployed on Amazon Elastic Kubernetes Service (Amazon EKS). This post shows how NAT's memo

hardwareaws-ml-blog

Build Applications on NVIDIA BlueField Faster with NVIDIA DOCA Agent Skills

NVIDIA DOCA AI agent skills supply verified API signatures, hardware capability checks, and build constraints that let agents fully understand the DOCA library (Flow, GPUNetIO, PCC, RDMA) for BlueFiel

hardwarenvidia-developer

Data-Efficient Adaptation of a Driving VLA to Class 8 Trucks

arXiv:2609.38570v1 Announce Type: new Abstract: Class 8 trucks differ from passenger cars in geometry, dynamics, and maneuvering requirements. As a result, vision-language-action (VLA) models trained

Dense Temporal Motion Retargeting for Legged Robots

arXiv:2609.38617v1 Announce Type: new Abstract: Legged robots can learn expressive whole-body skills from the motions of humans and animals. Due to the morphology gap between the source and the robot,

DynaFlow: Transparent and Flexible Intra-Device Parallelism via Programmable Operator Scheduling

arXiv:2605.21603v1 Announce Type: cross Abstract: Intra-device parallelism addresses resource under-utilization in ML inference and training by overlapping the execution of operators with different re

EDGC: Entropy-driven Dynamic Gradient Compression for Efficient LLM Training

arXiv:2511.10333v2 Announce Type: replace-cross Abstract: Training large language models (LLMs) at scale incurs substantial communication overhead, while static gradient compression cannot adapt to gr

Efficient Expert-Parallel Communication on PCIe-Connected Consumer GPUs

arXiv:2609.40093v1 Announce Type: cross Abstract: Expert parallelism (EP) enables inference of large Mixture-of-Experts (MoE) models by placing their experts across multiple GPUs, but requires substan

Experts say mounting cases of Nvidia chips reaching Chinese AI companies despite US export controls are increasingly pointing to gaps in Nvidia's due diligence (Mackenzie Hawkins/Bloomberg)

Mackenzie Hawkins / Bloomberg: Experts say mounting cases of Nvidia chips reaching Chinese AI companies despite US export controls are increasingly pointing to gaps in Nvidia's due diligence — Nvidia'

hardwaretechmeme

Fall Into 25 New Games on GeForce NOW This October

Spooky season is streaming in. Alongside falling leaves, pumpkin spice and everything nice, 25 new games are joining GeForce NOW throughout October, including six ready to play this week. From a new C

hardwarenvidia-blog

FlashDiffusion: Fused Tiled Kernel Spectral Decomposition

arXiv:2609.38198v1 Announce Type: new Abstract: Diffusion maps, and kernel methods more generally, provide an interpretable nonlinear spectral representation basis for geometric learning. In the geome

From world models to active agents: the next step for physical AI

Generative AI has made remarkable progress in creating increasingly realistic representations of the world. Image models can synthesize photorealistic scenes, video models can generate complex dynamic

hardwarelambda-labs

Gestalt: a meta-foundation model for astronomy

arXiv:2609.38312v1 Announce Type: cross Abstract: The Platonic Representation Hypothesis predicts that sufficiently scaled foundation models converge on a shared representation of the world. As each n

GPU-Accelerated Path-Dependent Marginal Information Gain for Autonomous Exploration

arXiv:2609.40297v1 Announce Type: new Abstract: Autonomous exploration demands that robots continuously evaluate candidate viewpoints based on their expected information gain and execution cost. Sampl

How NVIDIA GPUs Help Accelerate OpenAI’s GPT-6 Astra Ultrafast

GPT-6 Astra Ultrafast, running on NVIDIA Blackwell GPUs, is available now in the OpenAI API and to eligible ChatGPT Work and Codex users. Accelerated by inference optimizations through OpenAI’s models

hardwarenvidia-blog

HyDRA: A Hybrid Dual-Mode Network for Closed- and Open-Set RFFI with Optimized VMD

arXiv:2507.12133v2 Announce Type: replace Abstract: Device recognition is vital for security in wireless communication systems, particularly for applications like access control. Radio Frequency Finge

MEMO: Multi-Level Entity-Aware Memory for Streaming Video Understanding

arXiv:2609.38900v1 Announce Type: new Abstract: Streaming video understanding requires models to process unbounded visual streams while preserving rich visual semantics across vast temporal horizons,

NetApp and Nvidia rethink storage for AI factories

Storage architecture is being rewritten for artificial intelligence factories. Traditional enterprise storage was designed around workloads that scaled in relatively predictable ways. AI changes that

Nvidia ties AI factory economics to tokens and power efficiency

Artificial intelligence factory economics increasingly depend on more than access to high-performance graphics processing units. As agentic systems draw on multiple models, databases and tools, the en

Onboard Vision and MPC Navigation for Underwater Robots: An Open BlueROV2 Platform for Multi-Robot Experiments & Docking

arXiv:2609.38511v1 Announce Type: new Abstract: Autonomous underwater robots require robust perception, estimation and control to operate in confined environments. This paper presents an open-source B

PARK: Accurate Block Retrieval for Sparse Attention in Video Diffusion Transformers

arXiv:2609.38978v1 Announce Type: new Abstract: Diffusion Transformers (DiTs) have become a dominant architecture for video generation, but their efficiency is limited by the quadratic complexity of f

Productive, Durable, Fungible: How NVIDIA AI Factories Maximize Return on Investment

AI factories are built by the megawatt, even by the gigawatt. Each megawatt factory costs roughly $60 million, and AI factory operators will only commit capital on that scale with a clear view of the

hardwarenvidia-blog

Shared Phase and Retention Control for Efficient Adaptive Spectral Recurrence

arXiv:2609.39082v1 Announce Type: new Abstract: As new evidence arrives, a sequence model must update what it remembers and how memory influences predictions. While Transformers incur computation and

SoftBank made the final 10B investment in its 30B pledge to OpenAI's last funding round; source: Nvidia also made its final $10B investment in the round (The Information)

The Information: SoftBank made the final 10B investment in its 30B pledge to OpenAI's last funding round; source: Nvidia also made its final 10B investment in the round — Nvidia and SoftBank have each

hardwaretechmeme

SparLeak: Privacy Leakage from Sparse Attention in LLM Inference on Shared GPUs

arXiv:2609.38830v1 Announce Type: new Abstract: Sparse attention is widely used to accelerate long-context inference in modern large language models (LLMs), but its input-dependent execution behavior

Sparse-WAM: Accelerating World Action Models via Action-Guided Sparse Imagination

arXiv:2609.38984v1 Announce Type: cross Abstract: World-action models (WAMs) leverage pretrained video models to improve generalization in robot control by jointly predicting future visual states and

When Masking Helps or Hurts Robustness in Compressed CLIP: A Pre-Deployment Diagnostic

arXiv:2609.39704v1 Announce Type: cross Abstract: This paper demonstrate that whether masking-based token pruning helps or hurts worst-group robustness can be predicted before deployment, without labe

AI as a Compiler: Compiling Triton kernels without the Triton compiler

arXiv:2609.36800v1 Announce Type: new Abstract: Compiler backends are expensive to build and maintain as programming models, workloads, and accelerators evolve. We investigate whether large language m

BASE: Batch-Aware Selection of Experts Using Predicted Removal Error for Efficient MoE Decoding

arXiv:2609.36222v1 Announce Type: new Abstract: Large language models are increasingly expensive to serve. In large-scale serving systems, autoregressive decoding is often bottlenecked by transferring

BiFE: Search-Efficient Discovery of CPU-Only Branching Policies via LLM-based Bi-Fidelity Evolution

arXiv:2609.36735v1 Announce Type: new Abstract: In branch-and-bound (B&B) for mixed-integer linear programming (MILP), branching variable selection critically impacts efficiency. Existing neural branc

Build a multi-agent music production pipeline on Amazon Bedrock AgentCore Runtime Instances

Amazon Bedrock AgentCore Runtime Instances gives multi-agent workflows AWS managed EC2 infrastructure with GPUs, persistent volumes, and multi-day sessions. In this post, we deploy a three-agent music

hardwareaws-ml-blog

Cognition is the first customer running @NVIDIA Vera Rubin, powered by @CoreWeave! Hopper in 2022. Blackwell in 2024. Now Vera Rubin: On SWE…

Cognition is the first customer running @NVIDIA Vera Rubin, powered by @CoreWeave! Hopper in 2022. Blackwell in 2024. Now Vera Rubin: On SWE-2 inference, the new chips deliver about 4.8x more token th

hardwarecognition-ai--x

CoreWeave expands its AI stack as inference surges: theCUBE’s Fully Connected keynote analysis

Token economics are becoming a defining measure of artificial intelligence infrastructure efficiency. As AI workloads move beyond training, the economics of producing useful intelligence are starting

Deploying an HSTU Generative Recommender with NVIDIA Dynamo-Triton

Generative recommender systems model recommendation as high‑cardinality event streams, turning user actions, context, and candidate items into tokens for sequence modeling over user behavior. NVIDIA’s

hardwarenvidia-developer

DIET: Deletion-response Expert Trimming for Video Diffusion Transformers

arXiv:2609.37829v1 Announce Type: new Abstract: Video diffusion transformers (DiTs) increasingly adopt mixture-of-experts (MoE) architectures to reduce active computation, but their full expert storag

Embedded Bi-Temporal Building Damage Assessment for On-Board Data Reduction

arXiv:2609.37013v1 Announce Type: cross Abstract: Rapid assessment of building damage after natural disasters is essential to support emergency response. Earth Observation satellites can acquire relev

Expanding AI Storage Access with NVIDIA cuObject and the NVIDIA SCADA Server SDK

NVIDIA has released its cuObject client and server libraries, providing RDMA‑based APIs that allow GPUs to access object storage directly without routing data through the host CPU. The xio‑sig consort

hardwarenvidia-developer

FastVR: Efficient Streaming Video Restoration with One-Step Diffusion

arXiv:2609.36757v1 Announce Type: new Abstract: Diffusion-based video restoration recovers realistic details, but its practical deployment is limited by two efficiency bottlenecks: costly VAE encoding

Federation of Experts: Communication Efficient Distributed Inference for Large Language Models

arXiv:2605.06206v2 Announce Type: replace Abstract: Mixture of experts has emerged as the primary mechanism for making Large Language Models (LLMs) computationally efficient. However, in distributed s