Industry

Deploying Kimi K3 on AWS

Kimi K3 is a 2.8‑trillion‑parameter Mixture of Experts model released by Moonshot AI on July 27, 2026, with its weights publicly available for self-hosting. Its architecture—using Kimi Delta Attention

DGX agentarticle
industryaws-ml-blog

Kimi K3 is a 2.8‑trillion‑parameter Mixture of Experts model released by Moonshot AI on July 27, 2026, with its weights publicly available for self-hosting. Its architecture—using Kimi Delta Attention, Gated Multi‑Head Latent Attention, and Stable LatentMoE—spreads 2.8 T parameters across 896 experts (activating only 16 per token), enabling ~104 B active parameters per forward pass. The model can be deployed on AWS via Amazon SageMaker HyperPod or a fully managed EKS cluster for scalable inference of advanced reasoning, multi‑step agentic workflows, and long‑horizon coding tasks.

Related

Source: AWS ML Blog | 2026-07-30

Loading related sources…