Search: “models”

CUDA: fix 2 broken Volta FA cases (#29803) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/52093363 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silic

hexagon: add q2_k and q3_k quant type support (#29717) hexagon: add q2_k and q3_k quant type support hex-qk: consistent allocation of src1_row_size Co-authored-by: Max Krasnyansky maxk@qti.qualcomm.co

qwen4exp: fix tests (#29819) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/52169567 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, Kle

hexagon: install rebuilt HTP skels (#29828) hexagon: install rebuilt HTP skels Assisted-by: OpenCode hexagon: fix HTP skel catalog dependencies Assisted-by: OpenCode Website: https://llama.app Attesta

vulkan: add logging to pipeline compile issues (#29794) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/52203370 macOS/iOS: macOS Apple Silicon (arm64) macO

ggml : add alloc_buffer_n to buffer type interface (#23671) ggml : add alloc_buffer_n to buffer type interface Add alloc_buffer_n method to ggml_backend_buffer_type_i interface, with a public API ggml

qwen4exp : optimize mask constructions (#29824) qwen4exp : optimize mask constructions cont : apply the same change for GLM5-next Website: https://llama.app Attestations: https://github.com/ggml-org/l

vulkan: disable large matmul tile on Samsung GPUs with 32KB shared memory (#28531) Assisted-by: Claude Opus Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/

llama : preserve original batch order for speculative decoding layer inputs (#29019) llama: preserve original batch order for layer inputs Assisted-by: Codex tests: cover layer-input order across KV l

args: fix cli download mmproj arg (#28977) tests: add tests for cli download arg parsing args: fix cli download mmproj arg Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cp

Hexagon: optimize ALLREDUCE with support for safe scatter mode (#29757) hex-allreduce: add support for safe scatter mode hex-allreduce: pare down excessive comments hex-allreduce: re-write to remove r

cuda: guard the iq4_nl dequantize row kernel against short rows (#29683) dequantize_block_iq4_nl writes QK_K values per block, but a row can be shorter than that (an IQ4_NL row is only guaranteed to b

ggml-opencl : replace alloca() with std::vector (#29765) Signed-off-by: Adrien Gallouët angt@huggingface.co Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/

webgpu: fix SSM_SCAN binding aliasing (#29750) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/51685637 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple S

metal : use bf16 math for mxfp4 mul-mat (#29770) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/51752863 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple

llama-bench : fix verbosity filter to show GGML_LOG_ERROR (#28229) bench : fix verbosity filter to show GGML_LOG_ERROR (#28107) bench: remove dead variables Website: https://llama.app Attestations: ht

vocab : honor BOS/EOS settings for PLaMo-2 and PLaMo-3 (#29734) vocab : honor BOS/EOS settings for PLaMo-2 and PLaMo-3 The original tokenizer configs for PLaMo-2 and PLaMo-3 have add_bos_token: true a

opencl: mark vec subgroup bcast as supproted for Adreno E17 compiler (#29698) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/51780568 macOS/iOS: macOS Appl

common : add LLM-jp-4.1 Harmony dialect handler (#29681) LLM-jp-4.1 uses the GPT-OSS format, but its tokenizer decodes a space after every special token and parallel tool calls are separated by <|end|

BLAS : Document AOCL-BLAS build and label the device AOCL-BLAS (#29640) BLAS : Document AOCL-BLAS build and label the device AOCL-BLAS AOCL-Blas : Add an AOCL-BLAS Quick Start and drop the fixed versi

hex-workqueue: fix race condition in seqn getting out of sync with idx_read/write (#29785) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/51906249 macOS/iO

HIP: avoid treating CDNA as dgx spark for gqa_ratio 20 in fattn_mma dqk 576 (#29572) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/51919562 macOS/iOS: mac

llama-mmap : avoid a second full-size copy of each tensor with direct-io (#29749) Assisted-by: Claude Co-authored-by: Pranesh Gonegandla pgonegandla@nvidia.com Website: https://llama.app Attestations:

jinja : skip copying loop scope unless a loop filter needs it (#29776) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/51940374 macOS/iOS: macOS Apple Silic

meta: clear inactive AllReduce shards with FILL, not SCALE (#29793) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/51949614 macOS/iOS: macOS Apple Silicon

vulkan: Tune GDN kernel, fix Intel performance (#29476) vulkan: tune GDN shader tune for Intel Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/51306598 macO

opencl: fix get_tensor for q5_K adreno gemm_nonshuffle kernel (#29555) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/51311810 macOS/iOS: macOS Apple Silic

ci: add zdnn backend build but not test (#29541) ci: add zdnn backend build but not test Signed-off-by: Aaron Teo aaron.teo1@ibm.com ci: attempt to run a ubuntu 26.04 container Signed-off-by: Aaron Te

ggml-cuda: HIP: optimize packed byte subtraction (__vsubss4 -> __vsub4) (#29478) ggml-cuda: HIP: optimize non-saturating packed byte subtraction (__vsubss4) CI: ignore 1 spilled vgpr in fattn_vec Co-a

hexagon: optimize concat op (#29673) hex-concat: reduce pkts in gather/transpose hot loop gather directly into dst buffer, use special instruction for gather sync hex-concat: use fastdiv replace calls

ggml : check row bounds in get_rows_back (#29575) Signed-off-by: Adrien Gallouët angt@huggingface.co Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/5139241

gguf : reject tensor size that wraps after padding (#26979) GGML_PAD(nbytes, alignment) wraps to 0 when nbytes is within (alignment - 1) of SIZE_MAX, which silently bypassed the size overflow guard in

Hexagon f16 activation ops (#29209) hexagon: add F16 support for activation ops (SILU/GELU/GELU_QUICK/GEGLU/SWIGLU) Widens ggml_hexagon_supported_activations() to accept F16 (src0/dst/src1 must agree

ggml-zdnn: impl buffer reset, fix memory leaks (#29637) cont: fix code style Signed-off-by: Aaron Teo aaron.teo1@ibm.com Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/

vendor: update BoringSSL to 0.20260929.0 (#29669) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/51432581 macOS/iOS: macOS Apple Silicon (arm64) macOS Appl

SYCL: reduce tensor allreduce sync with pinned host buffers (#29604) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/51446793 macOS/iOS: macOS Apple Silicon

musa : define CUDA_ARCH for device passes (#29508) The MUSA vendor header never defined CUDA_ARCH, so every architecture test in the shared ggml-cuda sources evaluated to 0. Kernel bodies gated on the

openvino: serve GET_ROWS on a weight view from the base Constant (#28381) openvino: serve GET_ROWS on a weight view from the base Constant Resolve view_src when collecting weight Constants so a view o

cpu: accept BF16 in src1 of mul_mat (#28937) cpu: accept BF16 in src1 of mul_mat ggml_conv_1d_dw builds its im2col in F32 when the kernel is BF16, then calls ggml_mul_mat(im2col, kernel), which puts F

ggml : add BF16 unary, GLU, binary and scale ops (CPU, CUDA) (#29675) ggml : add BF16 unary, GLU, binary and scale ops (CPU, CUDA) ggml-cpu : use per-op _bf16 functions for BF16 unary and GLU ops Assi

jinja : support coerced array attributes (#29574) support coerced array attributes add tests Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/51590476 macOS/

mimo : support dflash (convert + feature extraction) (#29650) convert : update to support dflash cont : fix Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@huggingface.co Co-authored-by: Sigbjørn S

ggml/gguf : fix integer overflow (#29384) ggml: fix integer overflow guard for zero-element tensors ggml: validate number of elements in tensor to prevent integer overflow ggml: fix error print Websit

glm5-next: give dead indexer slots unique scatter rows (#29745) The sparse indexer mask is built with a set_rows scatter. Padded pools, absent sequences and missing tail cells all pointed to the same

batch: migrate the rest of examples to llama_batch_ext (#29601) migrate the rest test-thread-safety rm common_batch_staged Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cp

llama: properly handle KV on training (#28520) llama: properly handle KV on training improve Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/51644581 macOS/