All entries

cpu: fix AVX2 CPUs not using F16C when available (#30270) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/54796975 macOS/iOS: macOS Apple Silicon (arm64) ma

model : support for Prism Bonsai 2 27B (#29600) Runtime support for Prism Bonsai 2 27B Assisted-by: Claude Code address prism hadamard runtime feedback move hadamard tensors into method, define folded

rpc : turn GGML_RPC_DEBUG into a verbosity level and add logs GGML_RPC_DEBUG is now parsed as a number: 0/unset disables debug logs, 1-3 emit increasingly detailed output (events, per-command trace, t

opencl: fix image limit for q4_k dense bin kernels, q4_0 bcast and rms_norm (#30310) opencl: fallback when Q4_K weight images exceed device limits Co-authored-by: Hongqiang Wang wangh@qti.qualcomm.com

opencl: improve fa, allow dk512 for gemma-4, improve dk64 (#30266) opencl: enable Gemma-4 E4B GPU decode Co-authored-by: Hongqiang Wang wangh@qti.qualcomm.com opencl: extend Gemma-4 GPU decode to E2B

What's Changed ollama launch claude no longer shows a warning about Claude connectors by @hoyyeva in #18878 ollama launch codex no longer warns about service tiers by @hoyyeva in #18879 Paused backgro

sycl : accelerate MXFP4 MoE with arithmetic decoding and weight reordering (#29809) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/54540406 macOS/iOS: macO

opencl: add bin kernels kernel_gemm_moe_q4_k_q8_1_dp4a_bin, kernel_gemm_moe_q6_k_q8_1_dp4a_bin (#30187) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/5457

cmake(s390x): disable z17 target for unsupported compilers (#30297) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/54655455 macOS/iOS: macOS Apple Silicon

model : support MiniCPM-V 4.7 (#29416) mtmd : add MiniCPM-V 4.7 support Signed-off-by: tc-mb tianchi_cai@icloud.com model : allow mrope time from an extra position slot Signed-off-by: tc-mb tianchi_ca

server: leave a busy slot untouched when a request pins it (#30295) A request asking for a busy id_slot still ran the prompt cache update on that slot before being deferred. When the RAM cache held a

hexagon: fix IM2COL patch-embed DMA ring overflow (#30189) hexagon: fix IM2COL patch-embed DMA ring overflow The exact-tiling (stride == kernel, no pad/dilation) IM2COL DMA kernel issues ICKH DDR->VTC

CUDA: pass src1 precision to host MMQ config helpers (#30168) CUDA: pass src1 precision to host MMQ config helpers Signed-off-by: ynankani ynankani@nvidia.com make src1 prec explicit Signed-off-by: yn

metal: add the 128/96 flash attention kernels, accept every compiled pair (#30209) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/54260937 macOS/iOS: macOS

server: use port 9931 by default (#30159) server: use port 9931 by default revert unrelated changes Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/54269123

ci: fix Models Backend webgpu by supporting GGML_OP_DUP (#30216) The mixed batch path of PR-29622 writes the token rows with set_rows into a dup of the embeddings. WebGPU did not support DUP, so the d

musa: drop mp_21 from the default architectures (#30203) musa: drop mp_21 from the default architectures Signed-off-by: Xiaodong Ye xiaodong.ye@mthreads.com Address review comments Signed-off-by: Xiao

vulkan: fix rms_norm workgroup count overflow (#30145) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/54337638 macOS/iOS: macOS Apple Silicon (arm64) macOS

webgpu: use 2D workgroup dispatch for all the ops which use 1D dispatch (e.g., rms_norm) (#30219) remove 1D workgroups dispatching formatting Website: https://llama.app Attestations: https://github.co

meta : handle host views (#30217) meta : handle views of tensors allocated on the host A view shares the memory of its view_src, so ggml-alloc never allocates a view in the buffer of the split it land

ggml: fix OOB write in ggml_acc with negative offset (#30135) ggml_acc_impl narrowed a size_t offset to int32_t without checking that it fits, so a large offset could truncate to a negative int32_t. T

llama: keep the backend sampling graph static across ubatches (#30223) The reserve builds n_outputs_max_per_seq sampling chains per sampler, while a decode built one per output row, so the graph chang

chat : refactor API (#30210) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/54392536 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, Kle

model : use exact GELU for ModernBERT encoders (#30108) model : use exact GELU for ModernBERT encoders Assisted-by: Codex model : keep tanh GELU aliases on ggml_geglu Assisted-by: Claude Opus 5.5 mode

opencl: fix kernel compilation for a6x GPUs (#30176) opencl: skip kernel_cpy_f32_f32_pack on A6X to avoid shader compiler crash The A6x compiler backend found in iot device with a623 (E031.50.31.01) c

CUDA: Remove redundant CUDA copies after SSM_SCAN (#29807) CUDA: fuse copy of updated state snapshots into recurrent cache with ssm_scan CUDA: remove redundant cuda copies with K==1 (non spec-dec) sce

llama-bench: respect -fitc if bigger than required benchmark size (#28331) Assisted-By: opencode,llama.cpp,Qwen3.6-35B-A3B,Qwen3.8-27B Website: https://llama.app Attestations: https://github.com/ggml-

graph : reorder get_rows for embeddings (#30160) graph : reorder get_rows for embeddings cont : fix gemma4 and improve input embedding construction logic cont : add TODO for lora cont : fix raw embedd

CUDA: fix round issue, under MSVC the CPU and GPU agree (#30229) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/54453988 macOS/iOS: macOS Apple Silicon (ar

vendor: apply deep nested json patch from upstream (#30253) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/54488539 macOS/iOS: macOS Apple Silicon (arm64)

llama : add a GPU cache for MoE experts kept in host memory (#29887) llama : add a GPU cache for MoE experts kept in host memory Assisted-by: Claude use llama_moe_cache_ptr Website: https://llama.app

mtmd: add cohere2 vision support (#30062) cohere2 vision model address comments remove redundant mapping follow existing patterns fused linear_1 Website: https://llama.app Attestations: https://github

cuda: FWHT kernels for block widths above 512 (#29100) The CUDA FWHT covers widths 64 to 512. It runs one row per warp and keeps N/32 values per lane, so wider blocks need more registers per lane than

model : add LiquidAI/d1-3B decision model (#30110) model : add LiquidAI/d1-3b decision model mtmd : read LFM2 image resize algo from GGUF Assisted-by: Claude Opus 5.5 common : rename decision type d1

chat : name tool and argument parser rules by index (#30088) bugfix: infinite recursion caused by a tool named 'call'(#29967) chat : use index for schema and argument rules tests : remove tests tests

chat: fix jinja parser for TranslateGemma (#30096) chat: fix jinja parser for translategemma log if missing soruce_lang_code or target_lang_code Website: https://llama.app Attestations: https://github

hexagon: improved GELU accuracy (#30104) Assisted-by: OpenCode Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/53797268 macOS/iOS: macOS Apple Silicon (arm6

hexagon: support tiled Q4_K and Q6_K GET_ROWS (#30115) hexagon: support tiled Q4_K GET_ROWS Assisted-by: OpenCode properly reject Q4_K views Assisted-by: OpenCode hexagon: support tiled Q6_K GET_ROWS

model : add LiquidAI/d1-omni-600M decision model (#30114) model : add LiquidAI/d1-omni-600M decision model Assisted-by: Claude Opus 5.5 mtmd : keep conformer GLU sigmoid on CUDA Assisted-by: Claude Op

hexagon: Q6_K weight dequant speedup (#30121) hexagon: Q6_K weight dequant speedup Assisted-by: OpenCode unroll by another factor of 2 Assisted-by: OpenCode Website: https://llama.app Attestations: ht

hexagon: enable alloc_buffer_n (#30126) hex-bufs: add support for alloc_buffer_n hex-bufs: add support for splitting large tensors into separate buffers hex-bufs: update GGML_HEXAGON_MBUF to accept th

sycl: remove duplicate block-size defines from op headers (#29507) All were duplicates of the values in ggml/src/ggml-sycl/presets.hpp Website: https://llama.app Attestations: https://github.com/ggml-

sycl: add grouped MoE XMX GEMM (#29245) Co-authored-by: cwriter cwriter@localhost Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/53864714 macOS/iOS: macOS

sycl: fuse the delta-net alpha gate (add + unary + mul) (#29687) sycl: fuse the delta-net alpha gate (add + unary + mul) tests: cover the fused add + unary + mul chain sycl: give the fused alpha gate

CUDA: fix norm family kernels when ne[2]/ne[3] exceed grid dim limits (#28175) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/53919465 macOS/iOS: macOS App

cuda : Use byte strides for roll to allow non-contiguous ROLL operations (#29547) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/53926988 macOS/iOS: macOS