b9114
DGX agentBuild b9114 introduces a NCCL-free AllReduce implementation for tensor-parallel inference that pipelines device-to-host copy, cross-GPU communication, and reduction in a single CUDA kernel. The releas
Knowledge catalogue
Build b9114 introduces a NCCL-free AllReduce implementation for tensor-parallel inference that pipelines device-to-host copy, cross-GPU communication, and reduction in a single CUDA kernel. The releas
Build b9119 of llama.cpp introduces CUDA optimizations including an NCCL-free AllReduce implementation for tensor-parallel inference and updates to the llama-bench tool for managing reduction provider