Local Ai
b8742
llama.cpp release **b8742** (commit `7b69125`) is a incremental build of the C/C++ LLM inference engine focused on a Vulkan backend enhancement: it adds Q1_0 quantization type support to `ggml-vulk...
llama.cpp release b8742 (commit 7b69125) is a incremental build of the C/C++ LLM inference engine focused on a Vulkan backend enhancement: it adds Q1_0 quantization type support to ggml-vulkan, enabling get_rows, set_rows, and mul_mat(id) operations for this quantization format. Pre-built binaries are provided for a wide range of platforms including macOS (Apple Silicon and Intel), Linux (x64, arm64, s390x, with Vulkan, ROCm, and OpenVINO variants), Windows (CPU, CUDA 12/13, Vulkan, SYCL, HIP), and openEuler architectures.
Related
Source: local-ai