Hardware
Distributed training with Ray Train DLCs and EFA on EKS
The Ray Train Deep Learning Container ships the full CUDA-through-EFA stack, so you build no image. This post walks through a reproducible sample that fine-tunes Qwen2.5-1.5B with PyTorch FSDP across
The Ray Train Deep Learning Container ships the full CUDA-through-EFA stack, so you build no image. This post walks through a reproducible sample that fine-tunes Qwen2.5-1.5B with PyTorch FSDP across eight GPUs on two EFA-enabled g6.12xlarge instances on Amazon EKS, using the container exactly as published.
Related
- Fault tolerant distributed training on Amazon EKS using NVRx
- Run multi-node inference workloads using Ray LLM Deep Learning Containers
- Maximize AI Factory Energy Efficiency Through Full-Stack Inference and Training Optimizations
Source: AWS ML Blog | 2026-10-28