b10236
metal: implement DSv4 Lightning Indexer (#25893) metal: implement F16 Lightning Indexer Implement GGML_OP_LIGHTNING_INDEXER for 128-dimensional, 64-head inputs with F32 queries and weights plus F16 ke
Knowledge catalogue
metal: implement DSv4 Lightning Indexer (#25893) metal: implement F16 Lightning Indexer Implement GGML_OP_LIGHTNING_INDEXER for 128-dimensional, 64-head inputs with F32 queries and weights plus F16 ke
llama : allocate indexer cache only in 'full' indexer layers (#26474) Co-authored-by: Stanisław Szymczyk sszymczy@gmail.com Website: https://llama.app macOS/iOS: macOS Apple Silicon (arm64) macOS Appl
sycl: contiguous fast path + 32-bit index math for unary elementwise ops (#25946) sycl: contiguous fast path + 32-bit index math for unary elementwise ops sycl: use fastdiv for elementwise index math
mtmd: Add Vision Support for Minimax-M3 (#25113) Add preliminary MiniMax-M3 support Text-only port that re-uses existing components: MiniMax-M2 style GQA with per-head QK-norm and partial rotary, Deep
model : Granite-Switch Architecture (#25107) granite-switch: add llama.cpp backend (POC, CPU) New 'granite-switch' architecture: a dense, all-attention Granite-4.1 model with N embedded LoRA adapters
ggml : require contiguous src for ROLL on CUDA and Metal (#25928) ggml_roll only asserts nb[0] == ggml_type_size, so a permuted src is a valid input, but the CUDA and Metal roll kernels index by ne al
llama : support multi-output backend sampling (#25532) Enable backend sampling with token speculation Clamp the mask sum before converting it into the sampled index Add a numeric context parameter dec
sycl : Support DSv4 OPs: LIGHTNING_INDEXER,DSV4_HC_COMB,DSV4_HC_POST,DSV4_HC_PRE (#26568) support DSv4 OPs: LIGHTNING_INDEXER,DSV4_HC_COMB,DSV4_HC_POST,DSV4_HC_PREwq update ops.md fix format issue Web
metal : avoid threadgroup matrix array instantiation in kernel_lightning_indexer (#26646) In MSL, declaring an array of matrix types like threadgroup half4x4 causes a 'no matching constructor' compila
sycl: *glu flat path (#26354) tests: add SWIGLU perf cases perf mode had no GLU coverage. Adds SWIGLU at 17408 columns, 512 and 2048 tokens, f16 and f32, with the operands both fused and split. sycl:
Release b9413 includes a CUDA fix that checks PTX version on the host side to guard PDL dispatch, addressing an issue where incorrect dispatching could occur on newer GPU architectures like sm_90/sm_1
b9414 is a release build of llama.cpp that includes improvements to CUDA PTX version checking , which helps prevent incorrect kernel dispatch on different GPU architectures. This build also adds suppo
Build b8783 is a sequential incremental release of llama.cpp, the open-source C/C++ framework for running LLM inference locally and in the cloud. As with nearby builds in the b87xx series, it likely i
Build b8784 is a tagged release of llama.cpp, the open-source C/C++ library for efficient LLM inference maintained by ggml-org on GitHub. Like other incremental builds in the project's continuous rele
Build b8791 is an incremental release of llama.cpp, the open-source C/C++ library for local LLM inference maintained by ggml-org on GitHub. Like other numbered builds in the project's rapid release ca
Build b8775 is a specific incremental release of llama.cpp, the open-source C/C++ library for local LLM inference maintained under the ggml-org GitHub organization. Like other builds in its rapid, com
The search results did not return the specific changelog details for build b8756. Based on what is available and the general context of llama.cpp's rolling release model, here is a factual summary ...