hardware

Apple might make servers again to cash in on the AI rush

According to The Information, Apple is planning to get back into the server game and might just pair up with Nvidia to make it happen. Apple retired its Xserve line in 2011 and has largely left enterp

hardwarethe-verge-ai

Human

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Hardware

Banger paper from NVIDIA. It's on the topic of choosing which models go into a multi-agent system. The team compared eight selection strateg…

DGX agent

Banger paper from NVIDIA. It's on the topic of choosing which models go into a multi-agent system. The team compared eight selection strategies, based on size, accuracy, answer diversity and error div

hardwaredair-ai--x

16 Sept 2026

Confidential Computing keeps your data from being tracked or used in three ways: - End-to-end encrypted inference - Hardware-enforced isolat…

Confidential Computing keeps your data from being tracked or used in three ways: - End-to-end encrypted inference - Hardware-enforced isolation that extends to the GPU with @nvidia Confidential Comput

hardwarecohere--x

Emerald AI, Google and NVIDIA Launch Alliance to Advance Flexible AI Data Centers

AI factories are the infrastructure of the intelligence era. Scaling them responsibly will depend as much on innovation across the grid as inside the data center. Today, Emerald AI, Google and NVIDIA

Fault tolerant distributed training on Amazon EKS using NVRx

Integrate NVIDIA Resiliency Extension (NVRx) into PyTorch FSDP training on Amazon EKS to overlap checkpoint I/O with training and recover from GPU faults in seconds. This post covers async checkpointi

hardwareaws-ml-blog

FlashVector: Agent for Hierarchical Model Serving Stack Optimization

arXiv:2609.17391v1 Announce Type: new Abstract: Model serving is one of the largest cost drivers in production recommender systems. Maximizing its throughput requires navigating a deeply layered hiera

High-Performance Tensor Formulation of the Viterbi Algorithm for Hidden Semi-Markov Models

arXiv:2609.16500v1 Announce Type: new Abstract: Hidden Semi-Markov Models (HSMMs) are fundamental probabilistic models widely adopted across diverse domains, from computational biology to finance and

How to Use AI Agents to Prepare 3D Scenes for Simulation

Agentic AI workflows using NVIDIA Omniverse libraries automate preparation of Blender scenes for robotics simulation by adding semantic labels, sensor definitions, physics properties and validating th

Is INT8 Portable? A Cross-Platform Measurement Study of Quantized Inference on Embedded and Automotive Accelerators

arXiv:2609.16085v1 Announce Type: cross Abstract: Eight-bit integer (INT8) post-training quantization is the default recipe for edge deployment, under a widely held assumption: INT8 makes inference fa

NVIDIA Vera Rubin NVL72 Delivers Leading Performance in MLPerf Inference v6.1 Debut

System performance, efficient infrastructure scaling and continuous software optimization are key levers that determine AI inference economics. Higher system performance means more tokens generated, r

Sources: Apple is developing enterprise AI servers powered by two or four M8 Ultra chips, set for 2029, and is considering integrating Nvidia's NVLink Fusion (The Information)

The Information: Sources: Apple is developing enterprise AI servers powered by two or four M8 Ultra chips, set for 2029, and is considering integrating Nvidia's NVLink Fusion — Apple has been working

Sources: OpenAI and Anthropic staff felt blindsided by Dario Amodei's and Sam Altman's calls to slow the frontier; some fear evaluators may compromise security (Cristina Criddle/Financial Times)

Cristina Criddle / Financial Times: Sources: OpenAI and Anthropic staff felt blindsided by Dario Amodei's and Sam Altman's calls to slow the frontier; some fear evaluators may compromise security — St

Translating CUDA Tile Operations from Python to Rust Using Agentic AI

cuTile Rust extends Rust’s ownership model to tile‑based GPU kernels by splitting mutable outputs into disjoint parts while preserving host‑side ownership across launches. An agent skill translates cu

University of Manchester Uses NVIDIA Earth-2 to Forecast Air Pollution Across the UK

Air pollution is a serious public health risk, contributing to an estimated 30,000 deaths in the U.K. alone last year. Data-driven insights can help — but computing air quality with traditional chemis

Accelerating HKTex without Mesh Eigensystems: Local Unfolding and Randomized Thermal Features

arXiv:2609.14105v1 Announce Type: new Abstract: Heat Kernel Textures (HKTex) represent surface appearance with intrinsic anisotropic kernels, but evaluate them using 50 global Laplace-Beltrami eigende

Affinity-Aware Sharding for Delayed Tensor Parallelism

arXiv:2609.13846v1 Announce Type: cross Abstract: Delayed Tensor Parallelism (DTP) removes the blocking all-reduce of tensor-parallel Transformer inference. Every device adds its own partial output to

hardwarearxiv-cs-cl

AI Engineer Paris is one week away! A huge thank you to all our incredible sponsors for making this special event possible: @nvidia @Factory…

AI Engineer Paris is one week away! A huge thank you to all our incredible sponsors for making this special event possible: @nvidia @FactoryAI @sentry @CockroachDB @SonarSource @NotionHQ @SierraPlatfo

hardwareswyx--x

AI Infra Summit: NVIDIA Vera Rubin and DSX Platform Advancements Showcase Energy Efficiencies of Optimizing Tokens Per Watt for AI Factories

Ian Buck, vice president of hyperscale and high-performance computing at NVIDIA, Tuesday spoke on AI factory efficiency at the AI Infra Summit, the Santa Clara Convention Center event that has morphed

AI progress and responsibility: Nvidia, Anthropic and OpenAI CEOs weigh in at Salesforce’s annual event

If a measure of one firm’s impact is based on the company it keeps, then Salesforce Inc. has made a significant leap into the artificial intelligence conversation for 2026. At Dreamforce, the customer

hardwaresiliconangle

BOOST: Concurrent Access to Host Memory and HBM to Accelerate LLM Inference

arXiv:2609.13592v1 Announce Type: cross Abstract: GPU memory bandwidth and capacity limit throughput in large language model (LLM) inference. The GPU memory system consists of a primary tier of high-b

Communication-Efficient LLM Adaptation over Decentralized GPU Meshes

arXiv:2609.14339v1 Announce Type: new Abstract: Decentralized training enables large-model training over low-end GPUs and internet-grade connections, but communication along both data-parallel and pip

During a Salesforce event, Jensen Huang says the AI industry doesn't need any new laws or regulations and market forces will help companies safely innovate (Brody Ford/Bloomberg)

Brody Ford / Bloomberg: During a Salesforce event, Jensen Huang says the AI industry doesn't need any new laws or regulations and market forces will help companies safely innovate — Nvidia Corp. Chief

From Megawatts to Tokens: How NVIDIA Maximizes AI Factory Production

On a sweltering August evening in Silicon Valley, as the sun dropped and air conditioning loads spiked, Silicon Valley Power sent a signal to an AI factory to adjust its power consumption. Varun Sivar

Goal-Oriented Communications for Physical AI: Design and Testbed

arXiv:2609.15895v1 Announce Type: new Abstract: Physical AI relies on frequently-updated, latency-sensitive video stream to perceive, reason, and interact with the physical world, resulting in strict

hardwarearxiv-cs-ro

GzDRL: Reproducible and Scalable Deep Reinforcement Learning with Gazebo

arXiv:2609.13243v1 Announce Type: cross Abstract: We present GzDRL, a novel single-process reinforcement learning (RL) framework for Gazebo that overcomes longstanding bottlenecks in scalable, reprodu

How NVIDIA Groq 3 LPX Deterministic Execution Drives Power-Efficient High-Interactivity Inference on NVIDIA Vera Rubin

The NVIDIA Vera Rubin platform attains superior performance‑per‑watt by combining factory‑level DSX MaxLPS power shifting, rack‑level capacitors with Intelligent Power Smoothing, and the Groq 3 LPX de

How NVIDIA NVLink 6 Delivers Multi-Layer Resiliency for AI Factories

NVIDIA NVLink 6 offers a natively lossless fabric for large‑scale AI factories by integrating lightweight Forward Error Correction, physical‑layer retries, UPHY recovery and credit‑based flow control

Human Values in a Single Sentence: Moral Presence, Hierarchies, and Transformer Ensembles on the Schwartz Continuum

arXiv:2601.14172v4 Announce Type: replace-cross Abstract: We study neural multi-label classification under severe label imbalance through sentence-level detection of the 19 refined Schwartz human valu

Is Semantic SLAM Ready for Embedded Systems ? A Comparative Survey

arXiv:2505.12384v2 Announce Type: replace Abstract: Semantic SLAM holds promise for robust robot navigation in complex environments, but its practicality on embedded systems remains uncertain. This pa

hardwarearxiv-cs-ro

Jensen Huang completely destroys Jacob Coxon’s (ex-Anthrpic employee) 10% extinction prediction. no data, no scientific grounding, no defens…

Jensen Huang completely destroys Jacob Coxon’s (ex-Anthrpic employee) 10% extinction prediction. no data, no scientific grounding, no defensible 10%. 'First of all, we shouldn’t [try to explain a 10%

hardwareyann-lecun--x

LynnReal-Omni: Native multi-modal Video Generation for Agentic Visual Workflows

arXiv:2609.15863v1 Announce Type: new Abstract: Video diffusion models are stochastic and hard to control: precise content often requires repeated sampling without guaranteed success, and long-horizon

MedDiME: Efficient Latent Diffusion with Adaptive Masking for Medical Counterfactual Generation

arXiv:2609.15647v1 Announce Type: new Abstract: Medical counterfactual generation modifies images to change model predictions for interpretability. However, existing diffusion-based approaches are oft

mKernel: Fast Multi-GPU, Multi-Node Fused Kernels

arXiv:2609.13585v1 Announce Type: cross Abstract: Communication has become a bottleneck in distributed training and inference of large models. Overlapping communication with computation at the granula

Netherlands-based inference chip startup Euclyd raised a €200M+ Series A co-led by Samsung, Somerset Capital, Scaleup Europe Fund, and Innovation Industries (Kai Nicol-Schwarz/CNBC)

Kai Nicol-Schwarz / CNBC: Netherlands-based inference chip startup Euclyd raised a €200M+ Series A co-led by Samsung, Somerset Capital, Scaleup Europe Fund, and Innovation Industries — Samsung has bac

OpWeave: Flexible Operator Disaggregation for Heterogeneous LLM Serving

arXiv:2609.14237v1 Announce Type: cross Abstract: LLM serving systems increasingly disaggregate inference into finer-grained stages, with recent approaches separating attention from FFN or MoE executi

Partition-Aware Scheduling for Mobile Heterogeneous Inference Co-Execution

arXiv:2609.14213v1 Announce Type: cross Abstract: Modern mobile inference runs on heterogeneous platforms combining mobile GPUs with multiple CPU core clusters. Existing optimizations typically exploi

RAIN: Region-Aware Inversion Network for Semantic Watermark Extraction

arXiv:2609.14856v1 Announce Type: cross Abstract: Semantic watermarks for diffusion models embed ownership information into the generative process while preserving perceptual quality, but Gaussian-Sha

Scaling Federated Learning Across Docker, Kubernetes, and Slurm with NVIDIA FLARE

NVIDIA FLARE separates persistent federation services from dynamically launched job workers, allowing each participating site to deploy federated learning jobs on Docker, Kubernetes, or Slurm without

Towards Practical Precision Agriculture: Real-Time Fruit Detection and Video Analytics on Embedded Edge Hardware

arXiv:2609.13551v1 Announce Type: new Abstract: Static-image benchmarks do not capture the computational and temporal requirements of practical orchard video analytics. This study presents an end-to-e

Typhoon ASR Streaming: Steerable Low-Latency Thai Speech Recognition with Real-Time Shallow Fusion

arXiv:2609.14991v1 Announce Type: new Abstract: Open Thai automatic speech recognition (ASR) is dominated by offline, Whisper-based models that read the whole utterance before transcribing, ruling out

hardwarearxiv-cs-cl

VC-Attention: Value Smoothing and Softmax Casting for Low-bit Attention

arXiv:2609.15810v1 Announce Type: new Abstract: Diffusion Transformers deliver state-of-the-art video generation, but their long spatiotemporal sequences make attention the dominant deployment cost, a

Voice transcription is available for Apple Silicon Macs and PCs with NVIDIA GPUs. AMD support is in the works! Full Bionic 1.1.3 changelog: …

LM Studio’s Voice Transcription now supports Apple‑Silicon Macs and PCs with NVIDIA GPUs, with AMD GPU support slated for a future release. The announcement accompanies the Bionic 1.1.3 version, relea

hardwarelm-studio--x

Well.. @levie and I filmed this episode of Training Data a week or two ago, when the “current thing” was Doug Leone’s novacaine root canals …

Well.. @levie and I filmed this episode of Training Data a week or two ago, when the “current thing” was Doug Leone’s novacaine root canals instead of pacing the frontier… Simpler times! But Aaron’s a

hardwaresonya-huang--x

When Faster VLA Deployment Changes Closed-Loop Behavior: Task Success-Latency Analysis of SmolVLA Across PyTorch and ONNX Variants

arXiv:2609.14146v1 Announce Type: cross Abstract: Vision-language-action (VLA) deployment can reduce inference latency while changing closed-loop task behavior. We evaluate HuggingFaceVLA/smolvla_libe

woma: a real-time foundation model and its fine-tuned models for endoscopy

arXiv:2609.15130v1 Announce Type: cross Abstract: woma is a real-time foundation model for gastrointestinal endoscopy: a network trained without labels on about a million endoscopy frames, from which

AMDKernelVault: Large-Scale Datasets and Agentic Training for AMD GPU Kernel Optimization

arXiv:2609.12471v1 Announce Type: new Abstract: We introduce AMDKernelVault, an open HIP and Triton kernel corpus and training framework for recent AMD CDNA GPUs. Existing LLM-based kernel agents are

hardwarearxiv-cs-cl

14 Sept 2026

BRIDGE-EEG: Bridging Self-Supervised Pretraining and Efficient Deployment for Cross-Dataset EEG Classification

arXiv:2609.12218v1 Announce Type: cross Abstract: The growing use of electroencephalography (EEG) motivates automated analysis that is accurate, transferable, and deployable on constrained hardware. R

14 Sept 2026

Dissecting GPU Utilization for LLM Inference on Nvidia Hopper

arXiv:2609.12923v1 Announce Type: cross Abstract: A single SM utilization percentage can make an LLM inference workload look compute-saturated while hiding how much useful work is being done. The prob