Guard: Scalable Straggler Detection and Node Health Management for Large-Scale Training
arXiv:2605.17879v1 Announce Type: cross Abstract: Training frontier-scale foundation models involves coordinating tens of thousands of GPUs over multi-month runs, where even minor performance degradat