Search: “hardware”

Nice showcase that interesting LLM work can be done on single GPU!

hardwaresebastian-raschka--x

Nice showcase that interesting LLM work can be done on single GPU! I extended the GPT-2-style code from @rasbt's 'Build a Large Language Model (from Scratch)' so that it was a 6-expert (2 active) mixt

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Ordinary, Reasonable Chatbots: Do AI Models Track Human Legal Judgments?

DGX agent

arXiv:2609.06769v1 Announce Type: cross Abstract: As people increasingly rely on artificial intelligence (AI) for guidance in their own lives, scholars, lawyers, and even judges have begun to consider

hardwarearxiv-cs-ai

10 Sept 2026

Physical AI Takes the Wheel: How the World’s Robotaxi Leaders Are Building With NVIDIA Technologies

The global robotaxi market — physical AI’s first commercial breakthrough — is projected to reach $400 billion by 2035, with over 6 million commercial vehicles in operation as driverless fleets are alr

hardwarenvidia-blog

RAGMark: A Comprehensive Framework for Benchmarking Retrieval-Augmented Generation Systems

arXiv:2609.05760v1 Announce Type: cross Abstract: We present RAGMark, a modular benchmarking framework for advanced Retrieval-Augmented Generation (RAG) systems targeting small-scale multi-GPU environ

hardwarearxiv-cs-ai

Skild AI Taps NVIDIA Physical AI to Teach Robots New Tasks From a Single Video

Manufacturing floors, warehouses and production lines rarely stay fixed — tasks change, layouts shift and new products arrive, and most robots can’t keep up without significant reprogramming. Skild AI

hardwarenvidia-blog

SkNeXt enables topology-guided neuronal reconstruction from petabyte-scale microscopy data

arXiv:2609.09832v1 Announce Type: new Abstract: Recent advances in high-resolution fluorescence and electron microscopy have enabled nanoscale imaging across increasingly large brain volumes, but the

AI companies like @cohere build on both sides of the token economy: the models and the products that use them. By moving production workload…

AI companies like @cohere build on both sides of the token economy: the models and the products that use them. By moving production workloads to NVIDIA Blackwell, Cohere lowered token costs, increased

hardwarecohere--x

Apple A20 Pro debuts with 7-core GPU, 32-core Neural Engine and 50% more memory bandwidth (~115 GB/s)

It seems to use a 96-bit LPDDR5X memory bus, instead of the previous 64-bit wide busses. Considering it's on 2nm, that's expensive silicon. That should result in around 115 GB/s memory bandwidth. A20

hardwarer-localllama

Apple unveils the 2nm A20 Pro, featuring a 6-core CPU with two 'desktop class' super cores, a 7-core GPU up to 40% faster, and 32 Neural Engine cores in total (Hartley Charlton/MacRumors)

Hartley Charlton / MacRumors: Apple unveils the 2nm A20 Pro, featuring a 6-core CPU with two “desktop class” super cores, a 7-core GPU up to 40% faster, and 32 Neural Engine cores in total — Apple tod

hardwaretechmeme

CASCADE: A Spatio-Temporal-Causal Reasoning Representation and Dataset for Driving

arXiv:2609.07094v1 Announce Type: new Abstract: Reasoning is a promising route to the generalization that autonomous driving requires in the long tail, as it can infer how the elements of a scene depe

CUDA Toolkit 13.4 Adds Windows on Arm Support and Greater Control over Shared GPUs

CUDA Toolkit 13.4 introduces Windows‑on‑Arm support and preview functional compatibility for the NVIDIA Rubin architecture (compute capability 107), enabling cross‑platform CUDA development on ARM sys

hardwarenvidia-developer

Dense Structural Compression of Transformers via Gauge-Correct Channel Removal

arXiv:2609.07264v1 Announce Type: new Abstract: Inference energy per token drives the cost and carbon footprint of deployed transformers. It is dominated by dense matrix products that incur fused mult

Exclusive: Compute Exchange adds GPU inventory manager to simplify AI infrastructure purchases

The Compute Exchange Inc., a startup that matches buyers and sellers of graphics processing units, is launching a GPU inventory management capability intended to give enterprise buyers a consolidated

hardwaresiliconangle

FALCON-S: Fixed-wing ground-effect Aerodynamics Simulator and Flight Control Learning Suite

arXiv:2609.06046v1 Announce Type: cross Abstract: We present a modular, high-fidelity simulation framework for the development and benchmarking of flight control strategies in fixed-wing aerial robots

GPU-Enabled Large-Scale Optimization Using Randomized Linear Algebra

arXiv:2609.08136v1 Announce Type: new Abstract: This paper introduces rlaopt, a PyTorch-based package for large-scale optimization and scientific computing using randomized numerical linear algebra (R

Inverse Digital Marbling: Recovering Gesture Programs with a Replay Adjoint

arXiv:2609.08722v1 Announce Type: cross Abstract: Pigment deposition in paper marbling displaces the pattern already present, coupling the appearance of each gesture to later actions. We recover execu

Kalman Delta Networks: Uncertainty-aware Associative Memory

arXiv:2609.07816v1 Announce Type: new Abstract: Linear attention is increasingly used in frontier language models for efficient long-context inference and constant-memory decoding. Its fixed-size recu

Lightbits set to release KV cache engine to boost GPU performance

Lightbits Labs Ltd. today announced the general availability of Inferra, a software engine designed to improve the economics and performance of artificial intelligence inference by moving key-value ca

hardwaresiliconangle

mjorbit: A Simulation Framework for Space Robotics

arXiv:2609.08010v1 Announce Type: new Abstract: This paper presents a general framework for simulating multi-body space robots with contact. We bring efficient, large-scale robot simulation to in-spac

hardwarearxiv-cs-ro

MolParser-Mobile: Ultrafast OCSR System for Large-Scale Chemical Literature Mining

arXiv:2609.05807v1 Announce Type: new Abstract: Optical Chemical Structure Recognition (OCSR) is a fundamental component of chemical literature mining, enabling molecular database construction, reacti

NVIDIA Brings Real-Time AI to Broadcast, Sports and Global Streaming at IBC

At the IBC conference, running Sept. 11-14 in Amsterdam, the creative, technology and business communities are coming together to turn ideas into action and discuss innovations across the media and en

hardwarenvidia-blog

OCTN: Neural OCT Representations for Robot-Guided Precision Intervention

arXiv:2609.06810v1 Announce Type: new Abstract: Optical coherence tomography (OCT) offers compact, contactless, micron-scale imaging suitable for intraoperative guidance, but native OCT volumes are di

hardwarearxiv-cs-ro

Ostrich: Taking Large Strides Through Stiff Contact in Differentiable Dynamics

arXiv:2609.08800v1 Announce Type: cross Abstract: Three properties determine whether a differentiable simulator can drive gradient-based optimization through contact: simulation accuracy, gradient rel

PlayTrain: An Efficient Reinforcement Learning Framework for LLM-Generated Adaptable JavaScript Games

arXiv:2609.09059v1 Announce Type: new Abstract: While many video-game environments (VGEs) have played crucial roles in advancing reinforcement learning (RL), developing novel VGEs or modifying existin

Proper Dataset Valuation by Pointwise Mutual Information

arXiv:2405.18253v4 Announce Type: replace Abstract: Data plays a central role in advancements in modern artificial intelligence, with high-quality data emerging as a key driver of model performance. T

“real science is not a clout chase on social media or a compute spike spent to rob the clay mathematics institute it is a quest for elegance…

“real science is not a clout chase on social media or a compute spike spent to rob the clay mathematics institute it is a quest for elegance physical truth and universal rigor to decode reality true a

hardwaregary-marcus--x

RoLA: Rotary-Positioned Low-Rank Linear Attention for Efficient Diffusion Transformers

arXiv:2609.06712v1 Announce Type: new Abstract: Diffusion Transformers (DiTs) achieve strong video generation quality, but their dense spatiotemporal self-attention scales quadratically with sequence

Simplify and support your TorchServe workloads using Ray Serve Deep Learning Containers

TorchServe is no longer maintained, leaving teams to own the entire GPU inference stack. The AWS Ray Serve Deep Learning Container is a supported, pre-tested container with the framework, GPU drivers,

hardwareaws-ml-blog

Local Ai

TASTE: Throughput-Aware Batch Size Tuning for On-Device Edge Learning

arXiv:2609.07444v1 Announce Type: new Abstract: The rise of privacy-preserving artificial intelligence (AI) has shifted the focus of model adaptation and personalization towards on-device learning, wh

local-aiarxiv-cs-lg

TBDub: Production-Oriented Visual Dubbing

arXiv:2609.06144v1 Announce Type: new Abstract: Visual dubbing must synchronize mouth motion with replacement speech while preserving identity, appearance, and temporal consistency. Although X-Dub pro

When to Use Encode-Prefill-Decode Disaggregation to Accelerate Multimodal Model Serving

Encode‑Prefill‑Decode (EPD) disaggregation is an inference optimization in NVIDIA Dynamo that separates vision encoding from LLM prefill–decode stages for multimodal requests. On image‑heavy prompts,

hardwarenvidia-developer

Are there any (small, ~10B) models that you would say are a good collaborator?

Most of the new ~30B (and now ~10B, thankfully for my GPU) models we see score really high on benchmarks, but I feel like they don't push back on dumb ideas enough. I think most people don't being lik

hardwarer-localllama

i wish AI services let me pay more to seamlessly spin up powerful VMs to run my work on - i mean like high core count CPU instances, GPU ins…

David Hölz tweets that he would like cloud‐based AI platforms to offer easier, paid options for deploying high‑performance virtual machines—specifically servers with many CPU cores or dedicated GPU r

hardwaredavid-holz--x

Introducing CUDA Rust: Two Tracks for Writing GPU Kernels

NVIDIA introduced two Rust projects for GPU development in September 2026: `cuda‑oxide`, a nightly‑only backend that compiles SIMT‑style kernels to PTX via LLVM and uses DisjointSlice and launch contr

hardwarenvidia-developer

Led by @Samsung, co-led by @eqt's Scaleup Europe Fund and @PSG_equity, with continued backing from @ASMLcompany, @nvidia, @BNPParibas CIB an…

Led by @Samsung, co-led by @eqt's Scaleup Europe Fund and @PSG_equity, with continued backing from @ASMLcompany, @nvidia, @BNPParibas CIB and others. This fuels our infrastructure and product capabili

hardwaremistral-ai--x

Qualcomm signs a deal with Amazon to provide 'multiple generations of customized silicon' to help build AWS' AI infrastructure for inference; QCOM jumps ~5% (Ari Levy/CNBC)

Ari Levy / CNBC: Qualcomm signs a deal with Amazon to provide “multiple generations of customized silicon” to help build AWS' AI infrastructure for inference; QCOM jumps ~5% — Qualcomm shares rose 4%

hardwaretechmeme

SF Tech Week meets Fleet Week ✈️ Oct 9: Together AI, @dtcp_capital, and @nvidia are taking over a private waterfront chalet for a front row …

SF Tech Week meets Fleet Week ✈️ Oct 9: Together AI, @dtcp_capital, and @nvidia are taking over a private waterfront chalet for a front row seat to the Blue Angels. Custom aviators. Great food and dri

hardwaretogether-ai--x

BeaconKV: Key-Value Cache Compression Guided by Beacon Queries for Efficient Large Reasoning Model Inference

arXiv:2609.04971v1 Announce Type: cross Abstract: Large Reasoning Models (LRMs) achieve superior problem-solving through extended Chain-of-Thought (CoT) generation, but the resulting key-value (KV) ca

BIT.UA at BioASQ 14B: Modular Retrieval with pg_textsearch and Qdrant, and Agent-Based Answer Generation

arXiv:2609.04999v1 Announce Type: new Abstract: This paper describes the participation of the BIT.UA team from the University of Aveiro in the 14th edition of the BioASQ Task B challenge on biomedical

Cache-Aware Joint Router Adaptation for Memory-Efficient MoE Inference

arXiv:2609.04895v1 Announce Type: new Abstract: Mixture-of-Experts (MoE) models activate only a small subset of experts per token, but the full expert set often exceeds GPU memory, causing repeated we

Compact Neural Appearance Models for Efficient Gaussian Splatting

arXiv:2609.05255v1 Announce Type: new Abstract: Explicit primitive-based radiance fields such as 3D Gaussian Splatting typically model view-dependent appearance using low-order spherical harmonics (SH

From 80x to 385x: A Best-Matching-Unit Search at the L2 Roof, Measured Against a Symmetrically Tuned Baseline

arXiv:2609.05138v1 Announce Type: new Abstract: Comparisons between GPU implementations are usually asymmetric: one side is tuned by its author, the other is run as found. I report a programme that tu

GEPARD - Generative, Prosody-aware, Autoregressive text-to-speech model for Realtime Dialogue

arXiv:2609.04222v1 Announce Type: cross Abstract: We present GEPARD (Generative, Prosody-aware, Autoregressive text-to-speech model for Realtime Dialogue), a streaming text-to-speech model for real-ti

How far can we go with ImageNet for Text-to-Image generation?

arXiv:2502.21318v4 Announce Type: replace Abstract: Recent text-to-image (T2I) generation models have achieved remarkable sucess by training on billion-scale datasets, following a `bigger is better' p

I Ran 112 MiniMax H3 Tests on an RTX 3090 — Searching for the “Golden” Settings

hardwarer-stablediffusion

I ran a 112-case MiniMax H3 quality sweep on an RTX 3090 last night trying to find the best combos . Kept the prompt, seed, reference image, RefMods, Sage setup, sampler, and scheduler stayed constant

I’ve been overwhelmed and humbled by the fact that 99% of the reactions to our intent to join forces have been positive. ❤️ Prominent tech f…

I’ve been overwhelmed and humbled by the fact that 99% of the reactions to our intent to join forces have been positive. ❤️ Prominent tech figures, including some you could see as having a competitive

hardwareclem-delangue--x

little-coder vs just Pi

Hi, I use hermes as a harness, and I am pleased with it, but sometimes Hermes's context size is a bit too much for my system, so I wanted to delegate or straight up use a lighter option for coding tas

hardwarer-localllama

Low-Latency Spell Correction for Japanese Music Search Queries

arXiv:2609.04262v1 Announce Type: cross Abstract: Spell correction for Japanese search queries presents unique challenges due to the co-existence of four writing scripts (Latin/romaji, hiragana, katak