Model Releases
b10791
opencl: quant lm_head / decode GEMV and medium-batch GEMM optimizations (speculative decoding/MTP) (#26477) opencl: quant lm_head / decode GEMV and medium-batch GEMM optimizations opencl: guard q4_K/q
opencl: quant lm_head / decode GEMV and medium-batch GEMM optimizations (speculative decoding/MTP) (#26477) opencl: quant lm_head / decode GEMV and medium-batch GEMM optimizations opencl: guard q4_K/q6_K tiled_ns convert-kernel registration for non-Adreno build opencl: gate q4_K MUL_MAT+GLU fusion dispatch to Adreno opencl: require the noshuffle weight layout in the q4_K GLU fusion gate opencl: do not take the vectorized f16 mrow GEMV path on an unaligned row stride opencl: pass the new get_scale_min_k4 stride argument at the row-major call sites opencl: enable the q4_K split-K decode GEMV only where it is measured to win opencl: record the X1-85 split-K datapoint (neutral, exclusion confirmed) opencl: restrict the tiled lm_head/embed GEMV default to X2E/A8X opencl: fix q4_K variant kernels to read the transposed scales layout opencl: keep the flat-GEMV large-m escape opt-in opencl: guard the o4 GEMV store against the rounded-up dispatch tail opencl: restore the tiled q4_K/q6_K layout on tensor read-back opencl: split-K for the q8_0 decode GEMV at small M opencl: keep the q6_K noshuffle correctness escape ahead of the opt-in gate Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/45093115 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Android: Android arm64 (CPU) Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.3 DLLs Windows arm64 (CUDA 13) (preview) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI
Related
Source: llama.cpp Releases | 2026-09-03