Search: “hardware”

arXiv:2609.39223v1 Announce Type: new Abstract: Large language model (LLM) inference is increasingly moving toward lower precision to realize the throughput of hardware accelerators, but aggressive po

arXiv:2609.39082v1 Announce Type: new Abstract: As new evidence arrives, a sequence model must update what it remembers and how memory influences predictions. While Transformers incur computation and

The Information: SoftBank made the final 10B investment in its 30B pledge to OpenAI's last funding round; source: Nvidia also made its final 10B investment in the round — Nvidia and SoftBank have each

arXiv:2609.38830v1 Announce Type: new Abstract: Sparse attention is widely used to accelerate long-context inference in modern large language models (LLMs), but its input-dependent execution behavior

arXiv:2609.38984v1 Announce Type: cross Abstract: World-action models (WAMs) leverage pretrained video models to improve generalization in robot control by jointly predicting future visual states and

arXiv:2609.39704v1 Announce Type: cross Abstract: This paper demonstrate that whether masking-based token pruning helps or hurts worst-group robustness can be predicted before deployment, without labe

arXiv:2609.36800v1 Announce Type: new Abstract: Compiler backends are expensive to build and maintain as programming models, workloads, and accelerators evolve. We investigate whether large language m

arXiv:2609.36222v1 Announce Type: new Abstract: Large language models are increasingly expensive to serve. In large-scale serving systems, autoregressive decoding is often bottlenecked by transferring

arXiv:2609.36735v1 Announce Type: new Abstract: In branch-and-bound (B&B) for mixed-integer linear programming (MILP), branching variable selection critically impacts efficiency. Existing neural branc

Amazon Bedrock AgentCore Runtime Instances gives multi-agent workflows AWS managed EC2 infrastructure with GPUs, persistent volumes, and multi-day sessions. In this post, we deploy a three-agent music

Cognition is the first customer running @NVIDIA Vera Rubin, powered by @CoreWeave! Hopper in 2022. Blackwell in 2024. Now Vera Rubin: On SWE-2 inference, the new chips deliver about 4.8x more token th

Token economics are becoming a defining measure of artificial intelligence infrastructure efficiency. As AI workloads move beyond training, the economics of producing useful intelligence are starting

Generative recommender systems model recommendation as high‑cardinality event streams, turning user actions, context, and candidate items into tokens for sequence modeling over user behavior. NVIDIA’s

arXiv:2609.37829v1 Announce Type: new Abstract: Video diffusion transformers (DiTs) increasingly adopt mixture-of-experts (MoE) architectures to reduce active computation, but their full expert storag

NVIDIA has released its cuObject client and server libraries, providing RDMA‑based APIs that allow GPUs to access object storage directly without routing data through the host CPU. The xio‑sig consort

arXiv:2609.36757v1 Announce Type: new Abstract: Diffusion-based video restoration recovers realistic details, but its practical deployment is limited by two efficiency bottlenecks: costly VAE encoding

arXiv:2605.06206v2 Announce Type: replace Abstract: Mixture of experts has emerged as the primary mechanism for making Large Language Models (LLMs) computationally efficient. However, in distributed s

Building on nearly a decade of co-engineering, CoreWeave has built NVIDIA compute, networking and software into a cloud purpose-built for AI that’s still returning on investment across multiple genera

arXiv:2609.36074v1 Announce Type: new Abstract: Memory-efficient scaling on clustering problems without sacrificing statistical accuracy is of central interest for large-scale data analysis and machin

Phoebe Liu / The Information: GPU cloud provider GMI Cloud raised 668M, including 223M in equity led by ARCHIV with participation from Nvidia and 445M in credit led by Taiwanese bank CTBC — GMI Cloud,

arXiv:2609.38123v1 Announce Type: new Abstract: World simulation is inherently multisensory, demanding synchronized visual and acoustic dynamics in real time. Yet prevailing interactive world models r

I got thousands of DMs and it looks like @bot can't automatically analyze DMs (when @elonmusk?) so it will take me a few days to go through all of them, sorry! If you don't get an answer, don't take i

arXiv:2609.37481v1 Announce Type: new Abstract: Large-scale pervasive sensing increasingly relies on high-resolution satellite imagery, yet task-specific onboard vision is constrained by costly annota

Hi again! This is a update to my previous post MageTrail V0.25 where I continued this tech demo toy model thingy called MageTrail, a Danbooru/E621 proof of concept Full-Finetune of Microsoft's MageFlo

Bringing together the world’s brightest minds and the latest accelerated computing technology leads to powerful breakthroughs that help tackle some of the biggest research problems. To foster such inn

I'm part of the Lokutor team that built this. Model: NVIDIA Conformer-CTC Small (13M params, int8). It runs on an ESP32-S3 with 8 MB PSRAM, no GPU or NPU. LibriSpeech WER is 3.7 / 8.2, versus 6.3 / 15

Taiwan-based neocloud GMI Cloud Inc. wants to capitalize on what it says is an “unprecedented” demand for artificial intelligence computing power after raising a massive 663 million in funding from tw

arXiv:2609.36413v1 Announce Type: new Abstract: A pretrained video world model admits many plausible futures for a scene, but a robot must realize the exact task-conditioned one. To turn world models

arXiv:2609.38095v1 Announce Type: new Abstract: Backpropagation (BP) dominates deep learning but imposes a massive memory tax. For example, training OPT-30B with Adam requires approx 600GB of GPU memo

arXiv:2609.37850v1 Announce Type: new Abstract: Large generative models can recover realistic detail in real-world video super-resolution (VSR), but processing an entire video with them is computation

So I would like to share my analysis of PD disagg that I've run by Horace and many folks at Thinky You may have heard that PD disagg helps with per-token 'tail latencies' in ITL/TPOT, as prefill inter

Wall Street Journal: Sources: Jensen Huang and other execs asked Dario Amodei at the White House why he was so extreme in public on AI risks; Amodei said it's important to be honest — Nvidia's CEO was

Stealthium has joined the Vultr Cloud Alliance, adding GPU‑level observability and runtime security to Vultr’s AI infrastructure platform. As a member of NVIDIA’s Inception Program, Stealthium supplie

arXiv:2609.38169v1 Announce Type: cross Abstract: Linear attention replaces growing KV caches with fixed-size recurrent states, yet these persistent states can become a substantial memory bottleneck u

this should be fraud. certainly taxpayers shouldn’t be subsidizing Meta’s data centers. 🦔Meta classified its AI data centers as 'experimental pilot facilities' on its tax return. That let the Nvidia c

Top tech executives met with President Donald Trump on Tuesday to discuss the future of artificial intelligence amid growing concerns over AI models losing control. Researchers and lawmakers are calli

NVIDIA NeMo Relay supplies a common observability layer that captures ordered lifecycle events and structured trajectories—ATOF event streams, ATIF step‑by‑step footprints, and OpenTelemetry spans wit

arXiv:2609.37241v1 Announce Type: new Abstract: User-written Triton kernels enable high-performance GPU computation within PyTorch, but their end-to-end latency can remain dominated by host-side orche

Your agent got the right answer. How much work did it take to get there? We worked with @NousResearch/@Teknium on a hands-on walkthrough of NVIDIA NeMo Relay to collect traces for Hermes Agent. Run tw

Absolutely love this!! Open source all the way!! getting acquired by @nvidia = hugging face can now hire people we couldn't as a small startup and give them a decade to make open-source AI win! if you

arXiv:2609.34034v1 Announce Type: cross Abstract: A central aim of neuromorphic computing is to provide a viable alternative to highly energy-intensive Transformer-based AI. However, efficient alterna

Bloomberg: After lunch with AI leaders, Trump rejects new federal AI rules, says “we automatically have regulation” via DOJ and FBI but “self-regulation is very important” — President Donald Trump sho

NVIDIA TensorRT Model Connect is an open‑source library that delivers AI model reference implementations in C++ built on top of NVIDIA TensorRT, designed to make the inference stack accessible to deve

arXiv:2609.31683v1 Announce Type: new Abstract: This work presents an end-to-end demonstration of autonomous machine learning research conducted by an agent skill on consumer hardware. The demonstrati

arXiv:2609.33536v1 Announce Type: new Abstract: Large language model (LLM) serving is increasingly constrained by the GPU memory consumed by key-value (KV) caches. Existing compression, eviction, and

dream job token maxxing till open source wins getting acquired by @nvidia = hugging face can now hire people we couldn't as a small startup and give them a decade to make open-source AI win! if you're