Knowledge catalogue
arXiv:2609.13585v1 Announce Type: cross Abstract: Communication has become a bottleneck in distributed training and inference of large models. Overlapping communication with computation at the granula
Kai Nicol-Schwarz / CNBC: Netherlands-based inference chip startup Euclyd raised a €200M+ Series A co-led by Samsung, Somerset Capital, Scaleup Europe Fund, and Innovation Industries — Samsung has bac
arXiv:2609.14237v1 Announce Type: cross Abstract: LLM serving systems increasingly disaggregate inference into finer-grained stages, with recent approaches separating attention from FFN or MoE executi
arXiv:2609.14213v1 Announce Type: cross Abstract: Modern mobile inference runs on heterogeneous platforms combining mobile GPUs with multiple CPU core clusters. Existing optimizations typically exploi
arXiv:2609.14856v1 Announce Type: cross Abstract: Semantic watermarks for diffusion models embed ownership information into the generative process while preserving perceptual quality, but Gaussian-Sha
NVIDIA FLARE separates persistent federation services from dynamically launched job workers, allowing each participating site to deploy federated learning jobs on Docker, Kubernetes, or Slurm without
arXiv:2609.13551v1 Announce Type: new Abstract: Static-image benchmarks do not capture the computational and temporal requirements of practical orchard video analytics. This study presents an end-to-e
arXiv:2609.14991v1 Announce Type: new Abstract: Open Thai automatic speech recognition (ASR) is dominated by offline, Whisper-based models that read the whole utterance before transcribing, ruling out
arXiv:2609.15810v1 Announce Type: new Abstract: Diffusion Transformers deliver state-of-the-art video generation, but their long spatiotemporal sequences make attention the dominant deployment cost, a
LM Studio’s Voice Transcription now supports Apple‑Silicon Macs and PCs with NVIDIA GPUs, with AMD GPU support slated for a future release. The announcement accompanies the Bionic 1.1.3 version, relea
Well.. @levie and I filmed this episode of Training Data a week or two ago, when the “current thing” was Doug Leone’s novacaine root canals instead of pacing the frontier… Simpler times! But Aaron’s a
arXiv:2609.14146v1 Announce Type: cross Abstract: Vision-language-action (VLA) deployment can reduce inference latency while changing closed-loop task behavior. We evaluate HuggingFaceVLA/smolvla_libe
arXiv:2609.15130v1 Announce Type: cross Abstract: woma is a real-time foundation model for gastrointestinal endoscopy: a network trained without labels on about a million endoscopy frames, from which
arXiv:2609.12471v1 Announce Type: new Abstract: We introduce AMDKernelVault, an open HIP and Triton kernel corpus and training framework for recent AMD CDNA GPUs. Existing LLM-based kernel agents are
arXiv:2609.12218v1 Announce Type: cross Abstract: The growing use of electroencephalography (EEG) motivates automated analysis that is accurate, transferable, and deployable on constrained hardware. R
arXiv:2609.12923v1 Announce Type: cross Abstract: A single SM utilization percentage can make an LLM inference workload look compute-saturated while hiding how much useful work is being done. The prob
arXiv:2609.13010v1 Announce Type: new Abstract: Optimal transport (OT) compares distributions and aligns datasets in machine learning, yet unregularized discrete OT requires a linear program with quad
arXiv:2511.15015v4 Announce Type: replace-cross Abstract: Mixture-of-Experts (MoE) has become a practical architecture for scaling LLM capacity while keeping per-token compute modest, but deploying Mo
arXiv:2609.12412v1 Announce Type: cross Abstract: Foundation models, including large language models, vision-language models, and time-series foundation models, are increasingly deployed on embedded a
Hi, For single-GPU training, I’m using Hugging Face SFTTrainer with auto_find_batch_size=True, which automatically reduces the batch size after a CUDA OOM until it finds a batch size that works. I wou
My prompt is: Epic high-fantasy concept art, ultra-detailed. A road crossing golden plains leading toward a colossal dwarven mountain hall entrance recessed into themouth of a giant cave. The whole en
Nvidia CEO Jensen Huang took a call from President Trump on Monday while onstage at the All-In Podcast's All-In Summit. It's not the first time Huang has taken a call from the president during work, b
SAN FRANCISCO, CA, September 14, 2026 — Lambda, Inc. (“Lambda”), the Superintelligence Cloud, today announced it has signed the White House Ratepayer Protection Pledge, affirming its commitment to ens
maybe aidan was right and other companies are also starting to realize this, ZDR means nothing SITUATION DETECTED: Nvidia, Palantir, and Booz Allen Hamilton are restricting or eliminating the use of A
MUST SEE: Amazing moment as President Trump calls Nvidia CEO Jensen Huang while he's on stage at the All-In Summit. @POTUS on AI Doomerism: “I'm telling you, it's all a hoax… and we're not going to le
Shubhangi Goel / Business Insider: Nuance Labs, which builds low-latency AI avatars that can have face-to-face conversations, raised a 50M Series A led by Lightspeed, with Nvidia participating — A sta
The Information: Nvidia and Booz Allen Hamilton limit Fable use as Anthropic doesn't guarantee zero data retention; source: Palantir hasn't made Fable available via its software — As paranoia rises ov
Nvidia Corp. said today it’s tackling one of the major headaches for developers of quantum applications with the launch of a new orchestration layer within its open-source CUDA-Q platform. The announc
okay wow. per folks there, Trump called Jensen huang in the middle of his interview and jensen put the phone on speakerphone Jensen thanked trump for his social media post this morning pouring cold wa
arXiv:2609.11956v1 Announce Type: new Abstract: Post-training with reinforcement learning (RL) is a critical phase in the development of code-generating large language models (LLMs), as it ensures adh
arXiv:2609.12900v1 Announce Type: cross Abstract: Transient glacier simulations with higher-order ice flow require the repeated solution of a nonlinear problem as the geometry evolves. In the online m
Reasoning from scratch round 3: This time, I cover generating a verifier for... a) ...evaluation (base model versus any future model improvement) b) ...the reinforcement learning with verifiable rewar
arXiv:2609.11542v1 Announce Type: new Abstract: Large language model (LLM) training is among the fastest-growing sources of electricity demand in modern data centers, and power availability is a prima
arXiv:2609.10922v1 Announce Type: new Abstract: Auto-research agents have shown the potential to automate hypothesis generation, experiment execution, and iterative refinement. However, scaling this p
Networking technology startup Ayar Labs Inc. said today it has extended its recent late-stage funding round to 650 million after raising an additional 150 million from an unnamed investor. The company
arXiv:2609.11744v1 Announce Type: cross Abstract: Prefix caching can reduce the time to first token (TTFT) of long-context LLM requests by reusing previously computed key-value (KV) states, but for sh
arXiv:2609.10790v1 Announce Type: cross Abstract: We present a Kubernetes Dynamic Resource Allocation (DRA) driver that makes composable CXL memory a schedulable cluster resource, and evaluate the res
arXiv:2603.22437v2 Announce Type: replace-cross Abstract: We present mmFHE, the first system that executes the entire cloud-side mmWave sensing pipeline including the DSP and ML inference under fully
The article examines Nvidia’s role in the 11 trillion AI infrastructure boom, exploring how the company finances this growth through AI Compute, Capital and Markets models that reveal funding sources,
arXiv:2609.11133v1 Announce Type: new Abstract: Datacenter GPU power is the binding constraint on LLM serving capacity, and production serving has shifted to prefill/decode (PD) disaggregation. Deploy
arXiv:2609.11347v1 Announce Type: new Abstract: Knowledge graph foundation models such as ULTRA achieve zero-shot link prediction on unseen graphs through dedicated architectures that hard-code a tran
Reuters: Sources: Anthropic is in talks to bring on Nvidia as an anchor investor in its IPO, seeking up to 100B at a ~2T valuation; Nvidia may invest up to $10B — Anthropic is in talks to bring Nvidia
arXiv:2609.10656v1 Announce Type: cross Abstract: Selecting LoRA rank for diffusion fine-tuning requires balancing quality and compute cost. We present a controlled study on CIFAR-10 using a DDPM U-Ne
Spoke with many providers who lurk in this sub, plus met folks who work in inference. For a 10k monthly revenue, a provider was able to retain only 200 dollars in profit due to GPU costs. Their custom
Gear up: The latest PC games and major updates are ready to play on GeForce NOW this week. WARDOGS drops onto the cloud at early-access launch, alongside the Valheim 1.0 Deep North update and Bus Simu
Together AI announced the launch of “ThunderKittens” running on the NVIDIA Vera Rubin NVL72 platform, highlighting new performance gains and future directions. The announcement was shared via their Tw
AI inference chipmaker d-Matrix today announced it will use NVIDIA NVLink Fusion to connect its next-generation Raptor XPUs to NVIDIA’s AI infrastructure platform — joining a growing roster of ecosyst
I believe I may currently hold the record for memory constrained inference for Qwen3.8–Flash-Next on Apple Silicon — needing only about 21GB of allocations. Introducing Cherenkov, an inference engine
arXiv:2609.06157v1 Announce Type: cross Abstract: 3D Gaussian splatting (3DGS) represents scenes with explicit primitives and supports real-time novel-view synthesis, yet its system efficiency varies
NVIDIA’s BioNeMo Inference Runtime (BioIR) accelerates biomolecular structure‑prediction models on GPUs while preserving the familiar PyTorch workflow by providing an end‑to‑end pipeline that handles
arXiv:2609.05764v1 Announce Type: cross Abstract: The key-value (KV) cache is the dominant memory bottleneck in long-context large language model (LLM) decoding: every step reads it entirely, so decod
introducing preemptible compute for together gpu clusters same nvidia gpu infrastructure, 50% of the on-demand price built for evals, fine-tuning, batch inference + short experiments, with up to 5 min
Nice showcase that interesting LLM work can be done on single GPU! I extended the GPT-2-style code from @rasbt's 'Build a Large Language Model (from Scratch)' so that it was a 6-expert (2 active) mixt
arXiv:2609.06769v1 Announce Type: cross Abstract: As people increasingly rely on artificial intelligence (AI) for guidance in their own lives, scholars, lawyers, and even judges have begun to consider
The global robotaxi market — physical AI’s first commercial breakthrough — is projected to reach $400 billion by 2035, with over 6 million commercial vehicles in operation as driverless fleets are alr
arXiv:2609.05760v1 Announce Type: cross Abstract: We present RAGMark, a modular benchmarking framework for advanced Retrieval-Augmented Generation (RAG) systems targeting small-scale multi-GPU environ
Manufacturing floors, warehouses and production lines rarely stay fixed — tasks change, layouts shift and new products arrive, and most robots can’t keep up without significant reprogramming. Skild AI
arXiv:2609.09832v1 Announce Type: new Abstract: Recent advances in high-resolution fluorescence and electron microscopy have enabled nanoscale imaging across increasingly large brain volumes, but the
AI companies like @cohere build on both sides of the token economy: the models and the products that use them. By moving production workloads to NVIDIA Blackwell, Cohere lowered token costs, increased
It seems to use a 96-bit LPDDR5X memory bus, instead of the previous 64-bit wide busses. Considering it's on 2nm, that's expensive silicon. That should result in around 115 GB/s memory bandwidth. A20