Local Ai
We just open-sourced the world's fastest WebGPU kernels for local AI on Hugging Face
The collection includes kernels for more than 200 common ML operations, all of which can run entirely locally in your browser on WebGPU. We're also working to upstream these optimizations to Transform
The collection includes kernels for more than 200 common ML operations, all of which can run entirely locally in your browser on WebGPU. We're also working to upstream these optimizations to Transformers.js, ONNX Runtime Web, LiteRT.js, and more! Kernels: https://huggingface.co/kernels?platform=webgpu Blog: https://huggingface.co/blog/webgpu-kernels submitted by /u/xenovatech [link] [comments]
Related
- Bonsai 27B: 1-bit dense LLM running locally in your browser using custom WebGPU kernels
- Ion (zero install harness, runs on browser)
- LFM 2.5 230M running at 1440 tok/s in-browser through a custom backend
Source: r/LocalLLaMA | 2026-09-30