Model Releases
b11095
hexagon: new HMX-optimized GATED_DELTA_NET (#29199) hex-gdn: start putting together HMX support for GDN hex-gdn: working hmx but not-pipelined and slow for now hex-gdn: re-write vtcm layout handling a
hexagon: new HMX-optimized GATED_DELTA_NET (#29199) hex-gdn: start putting together HMX support for GDN hex-gdn: working hmx but not-pipelined and slow for now hex-gdn: re-write vtcm layout handling and prep for pipelining hex-gdn: starting to pipeline hmx and dmas hex-gdn: add hvx threading for most pipeline stages hex-gdb: add detailed trace events hex-gdn: vectorize expfs and use aligned hvx reads/writes hex-gnd: vectorize the rest of expf hex-gdn: optimize tail processing (pad partial chunks) hex-gdb: avoid float up/down casts in hot loops hex-fa: remove float up/down casts from inner loops hex-gdn: do exp() in f16 to improve HVX utilization hex-gdn: optimize tiler hex-hmx: bump hmx-queue to 128 and dispatch all GDN gemms at once hex-gdn: further pipeline improvements hex-gdn: optimize gdn prep stage hex-gdn: yet more tweaks to optimize GND_SOLVE task and pipeline hex-gdn: improve accuracy and optmize gdn-prep further hex-gdn: fix rebase conflict hex-bufs: revert max_bufsize enforcement, it is enough to just enforce max_vmem hex-scripts: improved inspect script to avoid false alarms in reg spill detector hex-fa: improve inline softmax with in-reg VKQ32 accum hex-fa: minor improvement for dma pipeline in hvx kernel hex-fa: reduce ddr reads by 20-30% during token gen hex-gdn: proper alignment for hvx vtcm spads Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/49097080 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Android: Android arm64 (CPU) Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI
Related
Source: llama.cpp Releases | 2026-09-22