Local Ai
Bonsai 27B: 1-bit dense LLM running locally in your browser using custom WebGPU kernels
Very impressive release by the PrismML team. 1-bit quantization shrinks it from 54GB to just 3.8GB (-93%), while retaining 90% of its intelligence. - Collection on Hugging Face: https://huggingface.co
Very impressive release by the PrismML team. 1-bit quantization shrinks it from 54GB to just 3.8GB (-93%), while retaining 90% of its intelligence. - Collection on Hugging Face: https://huggingface.co/collections/prism-ml/bonsai-27b - Demo link: https://huggingface.co/spaces/webml-community/bonsai-webgpu-kernels submitted by /u/xenovatech [link] [comments]
Related
- Welcome to Open Source AI: Run Your Own Models Locally https://x.com/i/broadcasts/1AGRnnELNODGl
- Was BitNet a dead end? What happened to ternary LLMs?
Source: r/LocalLLaMA | 2026-07-14