Hardware
NVIDIA NVbandwidth: Your Essential Tool for Measuring GPU Interconnect and Memory Performance
NVIDIA NVbandwidth is a performance analysis tool designed to measure memory bandwidth and latency between various components in GPU-equipped systems, providing detailed measurements of data transfer
NVIDIA NVbandwidth is a performance analysis tool designed to measure memory bandwidth and latency between various components in GPU-equipped systems, providing detailed measurements of data transfer rates between host CPUs and GPU devices (host-to-device and device-to-host), as well as inter-GPU communication bandwidth across NVLink and PCIe interconnects. Available as an open-source tool, it measures bandwidth for various memcpy patterns across different links using copy engine or kernel copy methods. NVIDIA has expanded NVbandwidth to support multi-node GPU cluster testing, enabling developers to measure bandwidth across node boundaries — a critical metric for deploying large language models and distributed training workloads.
Related
- VTC: DNN Compilation with Virtual Tensors for Data Movement Elimination
- Nvidia published DWDP (Distributed Weight-Data Parallelism), a new inference parallelism strategy focused on prefill. It sounds slightly ins…
- Running Large-Scale GPU Workloads on Kubernetes with Slurm
- Is an nvidia DGK Spark or similar worth it?
- Cut Checkpoint Costs with About 30 Lines of Python and NVIDIA nvCOMP
Source: NVIDIA Developer | 2026-04-14