Industry
Great to see this out, proud of the team!!! @AMD Instella 16B MoE foundation model, fully open with checkpoint after each stage from pretrai…
Great to see this out, proud of the team!!! @AMD Instella 16B MoE foundation model, fully open with checkpoint after each stage from pretraining, long-context, SFT, DPO and RL. Dataset detail, trainin
Great to see this out, proud of the team!!! @AMD Instella 16B MoE foundation model, fully open with checkpoint after each stage from pretraining, long-context, SFT, DPO and RL. Dataset detail, training recipe and code are published for reproducibility. This is our first MoE foundation model and out first with FarSkip architecture. @AIatAMD https://rocm.blogs.amd.com/artificial-intelligence/instella-moe/README.html https://github.com/AMD-AGI/Instella-MoE
Related
- ⚡️After weeks of hard work, we're thrilled to fully open-source HY World 2.0 today -- full inference code and all models! Build, explore, an…
- Great to see @poolsideai (US lab) committing to open sourcing their foundation models going forward Laguna is an interesting release, check …
- today, we release the open weights of Krea 2. welcome Krea 2 Raw and Krea 2 Turbo, an undistilled model from mid-training meant to be fine-t…
Source: Emad Mostaque (X) | 2026-07-25