Model Releases
Deploying Qwen3.8-2.4T-A95B on Amazon SageMaker HyperPod with vLLM
Learn how to deploy Qwen3.8-2.4T-A95B, a 2.4-trillion-parameter open-weight model, on Amazon SageMaker HyperPod with vLLM. This walkthrough covers cluster provisioning, NVFP4 quantization, and an Open
Learn how to deploy Qwen3.8-2.4T-A95B, a 2.4-trillion-parameter open-weight model, on Amazon SageMaker HyperPod with vLLM. This walkthrough covers cluster provisioning, NVFP4 quantization, and an OpenAI-compatible endpoint with built-in reasoning, tool calling, and native MTP speculative decoding.
Related
- Deploying Kimi K3 on Amazon SageMaker HyperPod and Amazon EKS
- Pathway’s brain-inspired architecture development on Amazon SageMaker HyperPod
- Spreading the load: How Salesforce met Multi-AZ HA with SageMaker Inference Components
Source: AWS ML Blog | 2026-09-09