hardware

arXiv:2609.12412v1 Announce Type: cross Abstract: Foundation models, including large language models, vision-language models, and time-series foundation models, are increasingly deployed on embedded a

Hi, For single-GPU training, I’m using Hugging Face SFTTrainer with auto_find_batch_size=True, which automatically reduces the batch size after a CUDA OOM until it finds a batch size that works. I wou

My prompt is: Epic high-fantasy concept art, ultra-detailed. A road crossing golden plains leading toward a colossal dwarven mountain hall entrance recessed into themouth of a giant cave. The whole en

Nvidia CEO Jensen Huang took a call from President Trump on Monday while onstage at the All-In Podcast's All-In Summit. It's not the first time Huang has taken a call from the president during work, b

SAN FRANCISCO, CA, September 14, 2026 — Lambda, Inc. (“Lambda”), the Superintelligence Cloud, today announced it has signed the White House Ratepayer Protection Pledge, affirming its commitment to ens

maybe aidan was right and other companies are also starting to realize this, ZDR means nothing SITUATION DETECTED: Nvidia, Palantir, and Booz Allen Hamilton are restricting or eliminating the use of A

MUST SEE: Amazing moment as President Trump calls Nvidia CEO Jensen Huang while he's on stage at the All-In Summit. @POTUS on AI Doomerism: “I'm telling you, it's all a hoax… and we're not going to le

Shubhangi Goel / Business Insider: Nuance Labs, which builds low-latency AI avatars that can have face-to-face conversations, raised a 50M Series A led by Lightspeed, with Nvidia participating — A sta

The Information: Nvidia and Booz Allen Hamilton limit Fable use as Anthropic doesn't guarantee zero data retention; source: Palantir hasn't made Fable available via its software — As paranoia rises ov

Nvidia Corp. said today it’s tackling one of the major headaches for developers of quantum applications with the launch of a new orchestration layer within its open-source CUDA-Q platform. The announc

okay wow. per folks there, Trump called Jensen huang in the middle of his interview and jensen put the phone on speakerphone Jensen thanked trump for his social media post this morning pouring cold wa

arXiv:2609.11956v1 Announce Type: new Abstract: Post-training with reinforcement learning (RL) is a critical phase in the development of code-generating large language models (LLMs), as it ensures adh

arXiv:2609.12900v1 Announce Type: cross Abstract: Transient glacier simulations with higher-order ice flow require the repeated solution of a nonlinear problem as the geometry evolves. In the online m

Reasoning from scratch round 3: This time, I cover generating a verifier for... a) ...evaluation (base model versus any future model improvement) b) ...the reinforcement learning with verifiable rewar

arXiv:2609.11542v1 Announce Type: new Abstract: Large language model (LLM) training is among the fastest-growing sources of electricity demand in modern data centers, and power availability is a prima

arXiv:2609.10922v1 Announce Type: new Abstract: Auto-research agents have shown the potential to automate hypothesis generation, experiment execution, and iterative refinement. However, scaling this p

Networking technology startup Ayar Labs Inc. said today it has extended its recent late-stage funding round to 650 million after raising an additional 150 million from an unnamed investor. The company

arXiv:2609.11744v1 Announce Type: cross Abstract: Prefix caching can reduce the time to first token (TTFT) of long-context LLM requests by reusing previously computed key-value (KV) states, but for sh

arXiv:2609.10790v1 Announce Type: cross Abstract: We present a Kubernetes Dynamic Resource Allocation (DRA) driver that makes composable CXL memory a schedulable cluster resource, and evaluate the res

arXiv:2603.22437v2 Announce Type: replace-cross Abstract: We present mmFHE, the first system that executes the entire cloud-side mmWave sensing pipeline including the DSP and ML inference under fully

The article examines Nvidia’s role in the 11 trillion AI infrastructure boom, exploring how the company finances this growth through AI Compute, Capital and Markets models that reveal funding sources,

arXiv:2609.11133v1 Announce Type: new Abstract: Datacenter GPU power is the binding constraint on LLM serving capacity, and production serving has shifted to prefill/decode (PD) disaggregation. Deploy

arXiv:2609.11347v1 Announce Type: new Abstract: Knowledge graph foundation models such as ULTRA achieve zero-shot link prediction on unseen graphs through dedicated architectures that hard-code a tran

Reuters: Sources: Anthropic is in talks to bring on Nvidia as an anchor investor in its IPO, seeking up to 100B at a ~2T valuation; Nvidia may invest up to $10B — Anthropic is in talks to bring Nvidia

arXiv:2609.10656v1 Announce Type: cross Abstract: Selecting LoRA rank for diffusion fine-tuning requires balancing quality and compute cost. We present a controlled study on CIFAR-10 using a DDPM U-Ne

Spoke with many providers who lurk in this sub, plus met folks who work in inference. For a 10k monthly revenue, a provider was able to retain only 200 dollars in profit due to GPU costs. Their custom

Gear up: The latest PC games and major updates are ready to play on GeForce NOW this week. WARDOGS drops onto the cloud at early-access launch, alongside the Valheim 1.0 Deep North update and Bus Simu

Together AI announced the launch of “ThunderKittens” running on the NVIDIA Vera Rubin NVL72 platform, highlighting new performance gains and future directions. The announcement was shared via their Tw

AI inference chipmaker d-Matrix today announced it will use NVIDIA NVLink Fusion to connect its next-generation Raptor XPUs to NVIDIA’s AI infrastructure platform — joining a growing roster of ecosyst

I believe I may currently hold the record for memory constrained inference for Qwen3.8–Flash-Next on Apple Silicon — needing only about 21GB of allocations. Introducing Cherenkov, an inference engine

arXiv:2609.06157v1 Announce Type: cross Abstract: 3D Gaussian splatting (3DGS) represents scenes with explicit primitives and supports real-time novel-view synthesis, yet its system efficiency varies

NVIDIA’s BioNeMo Inference Runtime (BioIR) accelerates biomolecular structure‑prediction models on GPUs while preserving the familiar PyTorch workflow by providing an end‑to‑end pipeline that handles

arXiv:2609.05764v1 Announce Type: cross Abstract: The key-value (KV) cache is the dominant memory bottleneck in long-context large language model (LLM) decoding: every step reads it entirely, so decod

introducing preemptible compute for together gpu clusters same nvidia gpu infrastructure, 50% of the on-demand price built for evals, fine-tuning, batch inference + short experiments, with up to 5 min

Nice showcase that interesting LLM work can be done on single GPU! I extended the GPT-2-style code from @rasbt's 'Build a Large Language Model (from Scratch)' so that it was a 6-expert (2 active) mixt

arXiv:2609.06769v1 Announce Type: cross Abstract: As people increasingly rely on artificial intelligence (AI) for guidance in their own lives, scholars, lawyers, and even judges have begun to consider

The global robotaxi market — physical AI’s first commercial breakthrough — is projected to reach $400 billion by 2035, with over 6 million commercial vehicles in operation as driverless fleets are alr

arXiv:2609.05760v1 Announce Type: cross Abstract: We present RAGMark, a modular benchmarking framework for advanced Retrieval-Augmented Generation (RAG) systems targeting small-scale multi-GPU environ

Manufacturing floors, warehouses and production lines rarely stay fixed — tasks change, layouts shift and new products arrive, and most robots can’t keep up without significant reprogramming. Skild AI

arXiv:2609.09832v1 Announce Type: new Abstract: Recent advances in high-resolution fluorescence and electron microscopy have enabled nanoscale imaging across increasingly large brain volumes, but the

AI companies like @cohere build on both sides of the token economy: the models and the products that use them. By moving production workloads to NVIDIA Blackwell, Cohere lowered token costs, increased

It seems to use a 96-bit LPDDR5X memory bus, instead of the previous 64-bit wide busses. Considering it's on 2nm, that's expensive silicon. That should result in around 115 GB/s memory bandwidth. A20

Hartley Charlton / MacRumors: Apple unveils the 2nm A20 Pro, featuring a 6-core CPU with two “desktop class” super cores, a 7-core GPU up to 40% faster, and 32 Neural Engine cores in total — Apple tod

arXiv:2609.07094v1 Announce Type: new Abstract: Reasoning is a promising route to the generalization that autonomous driving requires in the long tail, as it can infer how the elements of a scene depe

CUDA Toolkit 13.4 introduces Windows‑on‑Arm support and preview functional compatibility for the NVIDIA Rubin architecture (compute capability 107), enabling cross‑platform CUDA development on ARM sys

arXiv:2609.07264v1 Announce Type: new Abstract: Inference energy per token drives the cost and carbon footprint of deployed transformers. It is dominated by dense matrix products that incur fused mult