HetCCL: Enabling Collective Communication For Mixed-Vendor Heterogeneous Clusters
arXiv:2605.31000v1 Announce Type: cross Abstract: Training Large Language Models (LLMs) on heterogeneous clusters presents significant challenges for collective communication, as hardware from multipl