Local Ai
GitHub - google-ai-edge/ml-drift: GPU-Accelerated AI/ML Inference
Blog Post : ML Drift: Next-Gen GPU AI/ML Inference at the Edge - Google Developers Blog The Google AI Edge Team is excited to announce the open-source release of ML Drift, our high-performance, cross-
Blog Post : ML Drift: Next-Gen GPU AI/ML Inference at the Edge - Google Developers Blog The Google AI Edge Team is excited to announce the open-source release of ML Drift, our high-performance, cross-platform, on-device GPU compute engine specifically built for on-device AI/ML inference, under the Apache 2.0 license. By abstracting hardware and low-level API complexities of on-device GPUs across OpenGL ES, OpenCL, Metal, and WebGPU, ML Drift empowers developers to build real-time, interactive ML experiences from advanced video effects to generative AI across multiple platforms. Serving as the core GPU acceleration engine within LiteRT, ML Drift is also available as a standalone library for custom graphics and inference runtimes providing a unified foundation to deliver peak performance everywhere. submitted by /u/pmttyji [link] [comments]
Related
- Benchmarked inference engines for M1 Max 64gb-results & analysis
- parakeet.wgsl – Fast, accurate ASR in the browser, via raw WebGPU & SIMD WASM
- Bonsai 27B: 1-bit dense LLM running locally in your browser using custom WebGPU kernels
Source: r/LocalLLaMA | 2026-10-09