Search: “apple”

args: fix cli download mmproj arg (#28977) tests: add tests for cli download arg parsing args: fix cli download mmproj arg Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cp

Hexagon: optimize ALLREDUCE with support for safe scatter mode (#29757) hex-allreduce: add support for safe scatter mode hex-allreduce: pare down excessive comments hex-allreduce: re-write to remove r

cuda: guard the iq4_nl dequantize row kernel against short rows (#29683) dequantize_block_iq4_nl writes QK_K values per block, but a row can be shorter than that (an IQ4_NL row is only guaranteed to b

ggml-opencl : replace alloca() with std::vector (#29765) Signed-off-by: Adrien Gallouët angt@huggingface.co Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/

model : re-enable -sm tensor for qwen4exp (#28569) #27941 disabled -sm tensor for qwen4exp because test-llama-archs asserted on the Meta device once the fixture carried a PLE layer: GGML_ASSERT(ggml_b

llama-bench : fix verbosity filter to show GGML_LOG_ERROR (#28229) bench : fix verbosity filter to show GGML_LOG_ERROR (#28107) bench: remove dead variables Website: https://llama.app Attestations: ht

vocab : honor BOS/EOS settings for PLaMo-2 and PLaMo-3 (#29734) vocab : honor BOS/EOS settings for PLaMo-2 and PLaMo-3 The original tokenizer configs for PLaMo-2 and PLaMo-3 have add_bos_token: true a

common : add LLM-jp-4.1 Harmony dialect handler (#29681) LLM-jp-4.1 uses the GPT-OSS format, but its tokenizer decodes a space after every special token and parallel tool calls are separated by <|end|

BLAS : Document AOCL-BLAS build and label the device AOCL-BLAS (#29640) BLAS : Document AOCL-BLAS build and label the device AOCL-BLAS AOCL-Blas : Add an AOCL-BLAS Quick Start and drop the fixed versi

hex-workqueue: fix race condition in seqn getting out of sync with idx_read/write (#29785) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/51906249 macOS/iO

HIP: avoid treating CDNA as dgx spark for gqa_ratio 20 in fattn_mma dqk 576 (#29572) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/51919562 macOS/iOS: mac

llama-mmap : avoid a second full-size copy of each tensor with direct-io (#29749) Assisted-by: Claude Co-authored-by: Pranesh Gonegandla pgonegandla@nvidia.com Website: https://llama.app Attestations:

arXiv:2609.38294v1 Announce Type: new Abstract: We study the generation of agentic workflows that jointly optimize multiple objectives, such as accuracy, cost, latency, robustness, and consistency. Ex

vulkan: Tune GDN kernel, fix Intel performance (#29476) vulkan: tune GDN shader tune for Intel Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/51306598 macO

ci: add zdnn backend build but not test (#29541) ci: add zdnn backend build but not test Signed-off-by: Aaron Teo aaron.teo1@ibm.com ci: attempt to run a ubuntu 26.04 container Signed-off-by: Aaron Te

ggml-cuda: HIP: optimize packed byte subtraction (__vsubss4 -> __vsub4) (#29478) ggml-cuda: HIP: optimize non-saturating packed byte subtraction (__vsubss4) CI: ignore 1 spilled vgpr in fattn_vec Co-a

hexagon: optimize concat op (#29673) hex-concat: reduce pkts in gather/transpose hot loop gather directly into dst buffer, use special instruction for gather sync hex-concat: use fastdiv replace calls

model : support classifier_pooling for rerankers (#29627) model : support classifier_pooling for ModernBERT rerankers Assisted-by: Claude Opus 5.5 model : read classifier pooling type in load_hparams

ggml : check row bounds in get_rows_back (#29575) Signed-off-by: Adrien Gallouët angt@huggingface.co Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/5139241

gguf : reject tensor size that wraps after padding (#26979) GGML_PAD(nbytes, alignment) wraps to 0 when nbytes is within (alignment - 1) of SIZE_MAX, which silently bypassed the size overflow guard in

Hexagon f16 activation ops (#29209) hexagon: add F16 support for activation ops (SILU/GELU/GELU_QUICK/GEGLU/SWIGLU) Widens ggml_hexagon_supported_activations() to accept F16 (src0/dst/src1 must agree

ggml-zdnn: impl buffer reset, fix memory leaks (#29637) cont: fix code style Signed-off-by: Aaron Teo aaron.teo1@ibm.com Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/

add GLM-5.3-Flash (GLM5-Next) support (#27773) Rebase GLM-Next support onto master, and migrate to llama-memory-hybrid-idx Add initial MTP support Merge branch optimizations. Reduce allocated compute

musa : define CUDA_ARCH for device passes (#29508) The MUSA vendor header never defined CUDA_ARCH, so every architecture test in the shared ggml-cuda sources evaluated to 0. Kernel bodies gated on the

openvino: serve GET_ROWS on a weight view from the base Constant (#28381) openvino: serve GET_ROWS on a weight view from the base Constant Resolve view_src when collecting weight Constants so a view o

cpu: accept BF16 in src1 of mul_mat (#28937) cpu: accept BF16 in src1 of mul_mat ggml_conv_1d_dw builds its im2col in F32 when the kernel is BF16, then calls ggml_mul_mat(im2col, kernel), which puts F

ggml : add BF16 unary, GLU, binary and scale ops (CPU, CUDA) (#29675) ggml : add BF16 unary, GLU, binary and scale ops (CPU, CUDA) ggml-cpu : use per-op _bf16 functions for BF16 unary and GLU ops Assi

llama: llama_prefetch_rows (#29599) llama: llama_prefetch_rows llama: support row prefetch on Windows Apply the Windows port contributed by @praneshgo unchanged. Source: #29599 (comment) avoid exposin

ci : fix Models Backend Check by shortening the hrm_text fixture (#29744) The fixture recycles its two blocks over 8 cache slots, so the fp16 error builds up past the 1e-4 NMSE bound on the Vulkan T4

jinja : support coerced array attributes (#29574) support coerced array attributes add tests Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/51590476 macOS/

mimo : support dflash (convert + feature extraction) (#29650) convert : update to support dflash cont : fix Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@huggingface.co Co-authored-by: Sigbjørn S

cli: exit on stdin EOF and drop the console wide Ctrl+C broadcast (#29722) cli: exit on stdin EOF and drop the console wide Ctrl+C broadcast On Windows the simple input reader sends CTRL_C_EVENT to ev

ggml/gguf : fix integer overflow (#29384) ggml: fix integer overflow guard for zero-element tensors ggml: validate number of elements in tensor to prevent integer overflow ggml: fix error print Websit

glm5-next: give dead indexer slots unique scatter rows (#29745) The sparse indexer mask is built with a set_rows scatter. Padded pools, absent sequences and missing tail cells all pointed to the same

batch: migrate the rest of examples to llama_batch_ext (#29601) migrate the rest test-thread-safety rm common_batch_staged Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cp

llama: properly handle KV on training (#28520) llama: properly handle KV on training improve Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/51644581 macOS/

test-llama-archs : toggle causal_attn to catch graph shape changes (#29724) After the device decode, flip causal_attn off, decode n_ubatch/2 then n_ubatch tokens. Both have the same node count, so a s

https://preview.redd.it/xs01ds930nsh1.png?width=4800&format=png&auto=webp&s=939762bcf3fbd93e137d4f97e927dda38aaf30fd Back in July I shared LokalBot here. It's a free, open-source Mac app that records

Image-to-3D models redraw your picture, and fine detail - text, logos, faces - comes back garbled or scuffed. My local pipeline that fixes it. (repo link at the end of the post) The latest update adds

Memory chipmaker Micron Technology Inc. predictably delivered another blowout quarter in its latest financial results, with no sign of a slowdown in the demand for artificial intelligence infrastructu

arXiv:2609.35690v1 Announce Type: new Abstract: Robots that learn from a few demonstrations often require two forms of generalization. Compositional generalization recombines skills to solve new tasks

ci : update the oneAPI toolkit to 2026.1 (#29273) ci : update the oneAPI toolkit to 2026.1 oneDNN is removed from Intel Deep Learning Essentials in 2026.0, so staying on the deep-learning-essentials p

common : use fs::path for cache dirs (#29595) Avoid useless string conversions on Windows. No need for BSD or emscripten special cases. Signed-off-by: Adrien Gallouët angt@huggingface.co Website: http

chat : fix Muse Glimmer ignoring response_format json_schema with --jinja (#29615) chat : fix Muse Glimmer ignoring response_format json_schema with --jinja Fixes #29613 chat : accept json fences and

vulkan : reuse descriptor sets when bindings are constant (#29280) vulkan : reuse descriptor sets when bindings are constant vulkan : bump buffer_destroy_count before destroying the buffer Website: ht

ggml : collect all input tensors into graph_inputs (#29634) graph_inputs was populated while splitting the graph, so it only contained the inputs that are used as srcs of some node. With pipeline para