Model Releases
Run GGUF models directly with transformers. This work brings ggml's Metal kernels to the transformers ecosystem, increasing compatibility an…
Run GGUF models directly with transformers. This work brings ggml's Metal kernels to the transformers ecosystem, increasing compatibility and performance. More info below Millions of GGUF downloads la
Run GGUF models directly with transformers. This work brings ggml's Metal kernels to the transformers ecosystem, increasing compatibility and performance. More info below Millions of GGUF downloads later, those same llama.cpp checkpoints can now run in 🤗 transformers. Same models, more ways to use them, and fast local inference on Mac powered by ggml kernels! Blog: https://huggingface.co/blog/transformers-llama-cpp-quants ggml kernels: https://hu…
Related
- In HF GGUF section of models, we are emphasizing MTP heads with its own sign 𝗠𝗧𝗣
- Highlighting the new WebGPU backend in llama.cpp/ggml The work to bring full-fledged WebGPU support in llama.cpp started about an year and a…
- b10353
Source: Georgi Gerganov (X) | 2026-09-22