hardware

Kascade: A Practical Sparse Attention Method for Long-Context LLM Inference

arXiv:2512.16391v2 Announce Type: replace-cross Abstract: Attention is the dominant source of latency during long-context LLM inference, an increasingly popular workload with reasoning models and RAG.

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Korea’s Trillion-Dollar Sovereign AI Investment: Nvidia Wins, Hynix Loses

DGX agent

South Korea announced a sovereign AI investment exceeding one trillion dollars, awarding most of the contracts to Nvidia while sidelining competitors such as Hynix due to policy alignment criteria. Th

hardwaresemianalysis

1 Sept 2026

M2K: Making the Model-Kernel Interface Explicit for Reliable CUDA Kernel Verification

arXiv:2603.24595v2 Announce Type: replace-cross Abstract: Large language model (LLM) inference systems rely on CUDA kernels for core GPU computations, yet the interface between models and kernels is i

Multilingual Tiny (3.7B) Reasoning MoE pretrained from scratch on a consumer-grade GPU

Hello! I've just uploaded a recent checkpoint of my model trained from scratch: https://huggingface.co/piotr-ai/polanka_3.7b_exp_wip_260901 It was pre-trained, mid-trained, and fine-tuned on a single

hardwarer-localllama

NepScript Genesis: Neural Architecture Search for Handwritten Devanagari Digit Synthesis

arXiv:2608.29540v1 Announce Type: new Abstract: This paper introduces NepScript Genesis, a Neural Architecture Search (NAS) framework for automated Generative Adversarial Network (GAN) discovery, appl

NGD-SLAM: Towards Real-Time Dynamic SLAM without GPU

arXiv:2405.07392v4 Announce Type: replace-cross Abstract: Many existing visual SLAM methods can achieve high localization accuracy in dynamic environments by leveraging deep learning to mask moving ob

NVIDIA and CrowdStrike Strengthen Agentic Cybersecurity Frontier

“We’re at an inflection point in cybersecurity,” Jensen Huang told a sold-out crowd at CrowdStrike’s Fal.Con 2026 in Las Vegas Tuesday. Attacks are now automated. Defense has to be, too. The NVIDIA fo

hardwarenvidia-blog

Nvidia’s controversial DLSS 5 arrives September 3rd and requires serious GPU horsepower

Nvidia is officially launching DLSS 5 this week, following a divisive announcement in March where we likened the AI upscaling tech to a 'real-time generative AI filter for video games' and 'motion smo

hardwarethe-verge-ai

PowerSlider: Exploiting Phase Asymmetry for LLM Serving under Demand Response

arXiv:2608.21719v1 Announce Type: cross Abstract: AI inference clusters are increasingly constrained by instantaneous power, not just energy: grid operators condition new capacity on demand response,

Real-Time Video Anomaly Detection Using YOLO Pose Estimation and CLIP-Based Semantic Scoring

arXiv:2608.31074v1 Announce Type: cross Abstract: We propose a lightweight two-stage framework for real-time video anomaly detection. The first stage employs YOLO v11n-pose to detect persons and extra

Super interesting paper from Meta. Long-horizon research agents are coming. But one common problem with research agents today is the lack of…

Super interesting paper from Meta. Long-horizon research agents are coming. But one common problem with research agents today is the lack of originality and how to decide what experiments are worth ex

hardwaredair-ai--x

Benchmarking large language model agent societies against human behavioural distributions

arXiv:2608.28182v1 Announce Type: cross Abstract: Populations of large language model agents are increasingly used as experimental societies. Three doubts shadow every such result: whether the agents

Beyond Data Scaling: Representation-Centric Continued Pre-training for Vision-Language-Action Models

arXiv:2608.27550v1 Announce Type: cross Abstract: Scaling robot data is crucial for building generalist Vision-Language-Action (VLA) models, yet robot trajectories are harder to scale than web-scale i

DAMP: Decay-Aware Mixed-Precision Recurrent-State Quantization

arXiv:2608.27513v1 Announce Type: new Abstract: Softmax attention stores key and value vectors for every preceding token, causing inference memory to grow with sequence length. Recent language models

Doesn't this look like NVIDIA is price fixing?

According to this article Samsung has locked up the 70% of it's future ram production in contracts to companies like Microsoft, Google, and Nvidia. Everyone knows this is driving the ram price increas

hardwarer-localllama

GPU World: A story competition from Neal Stephenson, Gwern, and me. The AI future is unevenly distributed. What would the world look like wi…

GPU World: A story competition from Neal Stephenson, Gwern, and me. The AI future is unevenly distributed. What would the world look like with AI broadly diffused, such as if we had one GPU per person

hardwareemad-mostaque--x

Memory-efficient GPU pipelines for real-time non-line-of-sight reconstruction

arXiv:2608.28183v1 Announce Type: cross Abstract: Non-line-of-sight (NLOS) imaging reconstructs scenes hidden around a corner from indirect light recorded by a single-photon avalanche diode (SPAD). A

Not to Break, but to Attest: Adversarial Probes for Privacy-Preserving LLM Verification

arXiv:2608.27954v1 Announce Type: cross Abstract: Post-deployment changes to large language models can alter behavior while leaving routine outputs largely unchanged, creating a challenge for AI gover

Nvidia invests $3.5B in MediaTek as part of expanded AI chip partnership

Nvidia Corp. has bought 3.5 billion worth of MediaTek Inc. convertible bonds as part of an expanded partnership that the companies announced today. A convertible bond is a debt instrument that the buy

hardwaresiliconangle

Nvidia plans to invest 3.5B into MediaTek through convertible bonds; MediaTek forecasts AI chip revenue of about 2B this year (Bloomberg)

Bloomberg: Nvidia plans to invest 3.5B into MediaTek through convertible bonds; MediaTek forecasts AI chip revenue of about 2B this year — Nvidia Corp. is investing $3.5 billion into MediaTek Inc., de

On theCUBE Pod: Nvidia steamrolls expectations as Mythos shakes up cybersecurity

Nvidia Corp. might as well be swimming in money like Scrooge McDuck. The artificial intelligence firm had yet another astounding quarter, beating expectations for revenue. With that announcement came

hardwaresiliconangle

Quanta Perception as Probabilistic Events

arXiv:2608.27584v1 Announce Type: new Abstract: Autonomous systems rely on extracting information from light, yet remain brittle in extreme environments, from nighttime navigation to high-speed roboti

→ rollout throughput: generation speed and GPU utilization → weight sync: fresh weights on the rollout deployment every step → correctness: …

→ rollout throughput: generation speed and GPU utilization → weight sync: fresh weights on the rollout deployment every step → correctness: trainer and inference engine agreeing on the same model Cofo

hardwarefireworks-ai--x

Scale AV Perception Across Vehicle Platforms with NVIDIA Omniverse NuRec

NVIDIA Omniverse NuRec reconstructs real‑world driving scenes through 3D Gaussian splatting to produce the Physical AI NuRec Dataset—over 1,500 neural‑reconstructed videos (~20 s each) captured from s

hardwarenvidia-developer

SOMTab: Set-Order Mamba for Efficient Tabular In-Context Learning

arXiv:2608.27882v1 Announce Type: new Abstract: Tabular foundation models based on in-context learning have recently emerged as strong alternatives to task-specific model fitting. However, the current

Sources: Anthropic has signed a $35B cloud deal with Nvidia-backed Lambda; Nvidia will hold the lease on and supply chips to a Texas data center built by Hut 8 (Anissa Gardizy/Wall Street Journal)

Anissa Gardizy / Wall Street Journal: Sources: Anthropic has signed a $35B cloud deal with Nvidia-backed Lambda; Nvidia will hold the lease on and supply chips to a Texas data center built by Hut 8 —

Thread-Efficient Decoding for Neural Texture Compression

arXiv:2608.27888v1 Announce Type: new Abstract: Neural texture compression (NTC) achieves higher compression ratios than BCn formats but suffers from GPU thread divergence, which significantly reduces

ZipMVS: Multi-View Stereo with Compressed Cost Volumes

arXiv:2608.28033v1 Announce Type: new Abstract: Multi-view stereo (MVS) methods typically deliver highly accurate 3D reconstructions from multiple registered RGB images, thanks to the highly informati

Industry insiders say Chinese robot makers currently rely on Nvidia silicon and software; Nvidia's physical AI business generates ~$10B in annual revenue (Raffaele Huang/Wall Street Journal)

Raffaele Huang / Wall Street Journal: Industry insiders say Chinese robot makers currently rely on Nvidia silicon and software; Nvidia's physical AI business generates ~$10B in annual revenue — Busine

30 Aug 2026

Most Neoclouds Suck At Security

Most neoclouds exhibit weak security controls, exposing users to risks such as container escapes, kernel bypasses, compromised network policies, insecure credential handling, and multi‑tenant Grafana

hardwaresemianalysis

30 Aug 2026

A Survey of LLM Prompt Datasets: Taxonomy, Linguistic Patterns, and Practical Uses

arXiv:2510.09316v3 Announce Type: replace-cross Abstract: We compile 129 public LLM prompt datasets with more than 1.22TB and more than 673M instances and organize them into a unified taxonomy. We use

Deploy an Open Model from Checkpoint to Inference in Two Commands with NVIDIA TensorRT Model Connect

NVIDIA TensorRT Model Connect delivers a set of reference implementations for deploying open‑source models from Hugging Face checkpoints to native C++ inference in two steps: a Python CLI builds a dep

hardwarenvidia-developer

Double standard @sama . Exactly two years ago, he belittled @dylan522p as the 'SemiAnalysis' guy after not liking a Google analysis. Altman'…

Double standard @sama . Exactly two years ago, he belittled @dylan522p as the 'SemiAnalysis' guy after not liking a Google analysis. Altman's now kissing Dylan's ass, inviting SemiAnalysis to OpenAI l

hardwaredylan-patel--x

FlashVLA: Streaming Action Decoding for Fast and Asynchronous VLA Inference

arXiv:2608.27384v1 Announce Type: new Abstract: Vision-Language-Action (VLA) models are increasingly promising for robotic manipulation, yet their real-world deployment remains bottlenecked by high in

hardwarearxiv-cs-ro

It’s Nvidia’s world. We just live in it

The artificial intelligence juggernaut kept cruising along this week thanks to big earnings results from Nvidia — and even Salesforce, the supposed epicenter of the SaaSpocalypse. Nvidia not only beat

hardwaresiliconangle

Modders get an experimental version of Nvidia's DLSS 5 Neural Rendering library running in over a dozen games after it leaked in NBA 2K27's early access build (VideoCardz.com)

VideoCardz.com: Modders get an experimental version of Nvidia's DLSS 5 Neural Rendering library running in over a dozen games after it leaked in NBA 2K27's early access build — DLSS 5 mod spreads to C

Pushing the Envelope of LLM Inference with Ultra-Low-Bit Quantized Models

arXiv:2508.06753v3 Announce Type: replace Abstract: The advent of ultra-low-bit LLM models, approaching the perplexity and task accuracy of their full precision counterparts, is ushering in a new era

Sources: AI cloud computing provider Lambda raised ~$1B of private short-dated debt to finance the purchase of Nvidia GPUs, which will be leased by Microsoft (Emily Graffeo/Bloomberg)

Emily Graffeo / Bloomberg: Sources: AI cloud computing provider Lambda raised ~1B of private short-dated debt to finance the purchase of Nvidia GPUs, which will be leased by Microsoft — Lambda Inc., a

We've open sourced Minimax H3 that generates 15s 768p in 13s and 14x faster on single GPU

hardwarer-stablediffusion

Hi! The team who collaborated and built optimized open source Minimax H3 here, full details below: https://x.com/haoailab/status/2093391548289540596?s=20 https://reddit.com/link/1w0xkpb/video/zpjrbdb0

BanglaMamba: Exploring State Space Models for Bangla Fake News Detection

arXiv:2608.25190v1 Announce Type: new Abstract: Fake news detection has become an important Natural Language Processing (NLP) task due to the rapid spread of misinformation through online news platfor

Comparing Corrupted Constrained Learning Problems

arXiv:2608.25745v1 Announce Type: new Abstract: A key result in statistics is the data processing inequality, originally proved by Blackwell (1951) and later refined by DeGroot (1962) in terms of stat

CRESSim-Neo: A Batched GPU Simulation Engine for Surgical Robotics and Robot Learning

arXiv:2608.25192v1 Announce Type: new Abstract: We introduce CRESSim-Neo, a batched GPU simulation engine for surgical robotics and robot learning. CRESSim-Neo combines position-based simulation of ri

hardwarearxiv-cs-ro

DataKernelBench: Can LLMs Optimize Database Queries on GPUs?

arXiv:2608.25061v1 Announce Type: new Abstract: GPUs increasingly accelerate database systems, but query-specific peak performance still often relies on hand-written kernels. Existing LLM kernel bench

Deepgram deepens Amazon SageMaker AI observability with Enhanced Metrics

Self-hosted speech AI carries an observability trade-off: the numbers that drive capacity planning and cost management stay locked inside the vendor container. Deepgram closes that gap on Amazon SageM

hardwareaws-ml-blog

ExFold: Unified Expert Folding for Training-Free MoE Prefill-Decode Acceleration

arXiv:2608.24938v1 Announce Type: new Abstract: Mixture-of-Experts (MoE) models scale capacity for strong quality while keeping per-token compute bounded through sparse expert activation. Yet low-late

GeForce NOW Gives Gamers More Ways to Play at Gamescom 2026

NVIDIA’s Gamescom announcements are revealing what’s next for GeForce NOW, with new ways to play, more supported devices and platforms, and even more big PC games headed to the cloud. New NVIDIA DLSS

hardwarenvidia-blog

HuggingFace now comes in a signature leather jacket

Nvidia has agreed to acquire Hugging Face for **$12.9 billion** in an executive‑level announcement. The deal marks a significant expansion of Nvidia’s AI ecosystem, bringing Hugging Face’s open‑source

hardwaredavid-ha--x

Jensen Huang says Nvidia achieved AGI, again — not that it matters

On Nvidia's earnings call Wednesday, CEO Jensen Huang casually announced the company had 'achieved AGI,' one of the tech industry's ultimate goals some of its biggest players have spent years chasing.

hardwarethe-verge-ai