Model Releases
Ternary Bonsai 2 (2B, 4B, and 9B) just released on Hugging Face. The 2B can run entirely locally in the browser at up to 500 tok/s on an M4 Max with custom WebGPU kernels.
Models on HF: https://huggingface.co/collections/prism-ml/bonsai-2-small WebGPU demo: https://huggingface.co/spaces/webml-community/ternary-bonsai-2-hermes-webgpu submitted by /u/xenovatech [link] [co
Models on HF: https://huggingface.co/collections/prism-ml/bonsai-2-small WebGPU demo: https://huggingface.co/spaces/webml-community/ternary-bonsai-2-hermes-webgpu submitted by /u/xenovatech [link] [comments]
Related
- Ternary Bonsai 2 (27B) just released on Hugging Face. At <6GB in size, it can even run locally in-browser on WebGPU.
- Prism-ML Bonsai 2 Joins Our Qwen3.8 Quantization Comparison
- 1-bit / 2-bit / Ternary / Bitnet Models - Updates & Tracking
- Bonsai-27B & Ternary-Bonsai-27B - Updates (on PRs)
Source: r/LocalLLaMA | 2026-10-15