Research
Anyone have an S3-compatible store that actually saturates H100s without the AWS egress tax? [R]
A r/MachineLearning discussion explores the challenge of finding S3-compatible object storage that can both saturate H100 GPU bandwidth and avoid AWS's egress fees during high-throughput AI trainin...
A r/MachineLearning discussion explores the challenge of finding S3-compatible object storage that can both saturate H100 GPU bandwidth and avoid AWS's egress fees during high-throughput AI training workloads. Community recommendations center on providers like Cloudflare R2 and Tigris, which genuinely offer unlimited free egress with no asterisk , as well as self-hosted solutions such as MinIO on bare-metal servers, which provide the same S3 API without the egress tax . The core trade-off highlighted is that transferring large model checkpoints out of AWS incurs significant egress fees on top of GPU costs, and at scale, egress can easily match or exceed the GPU compute bill , making egress-free alternatives critical for cost-efficient H100 training pipelines.
Related
- AI Systems Performance Engineering by Chris Fregly - is it worth it? [D]
- [[d-60-matmul-performance-bug-in-cublas-on-rtx-5090-d|[D] 60% MatMul Performance Bug in cuBLAS on RTX 5090 [D]]]
- What if your HNSW index stored 3-bit embeddings instead of float32? [R]
- [[p-pca-before-truncation-makes-non-matryoshka-embeddings-comp|[P] PCA before truncation makes non-Matryoshka embeddings compressible: results on BGE-M3 [P]]]
Source: research