Search: “apple”

mtmd: support dots3-note vision+audio (#27524) text: conversion init impl mtmd: conversion impl mtmd cpp Update gguf-py/gguf/tensor_mapping.py Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@huggin

ci : Restore ROCm job for Ubuntu (#27399) Revert 'ci : disable ubuntu-rocm (#26969)' This reverts commit 9558fa4. ci: set ccache compiler_check=content for ROCm build The ROCm toolchain is pip-install

fit: also take into account n_streams (#27496) fit: also take into account n_streams server: make the draft context follow the target context With a non-unified KV cache the target context now holds n

common: add json.h abstraction (#27511) add common/json migrate common adapt jinja migrate server big wip migrate tests wip revert some excessive changes wip wip 2 revert redundant changes fix server

mtmd: use ggml_rope_set_offset (#27521) mtmd: use ggml_rope_set_offset add comment Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/42334609 macOS/iOS: macOS

vulkan : added the PAD_REFLECT_1D operation (#26586) vulkan : added PAD_REFLECT_1D operation Implemented the GGML_OP_PAD_REFLECT_1D operation for the Vulkan backend Changes: pad_reflect_1d.comp: imple

Revert 'tensor-split meta backend fixes (#26502)' (#27433) This reverts commit d59d455. Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/42012577 macOS/iOS:

metal : dequantize quantized KV to F16 before flash attention (#27390) metal: dequantize q8_0 KV to f16 before flash attention Add a preprocessing pass for GGML_OP_FLASH_ATTN_EXT on the Metal backend:

common : gracefully fallback on unsupported regex patterns in JSON schema (#26939) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/42018860 macOS/iOS: macOS

CUDA: adding switch points per HW and quant type to tune the mvq->MMQ decode crossover (#26079) CUDA: runtime GGML_CUDA_MMVQ_MAX to tune the mvq->MMQ decode crossover Add a runtime override of the mul

server: (router) lazy-load startup_models after main setup (#27424) server: (router) lazy-load startup_models after main setup only allow is_first_load to populate it nits nits 2 Website: https://llam

CI: Use LLVM's OpenMP over MSVC_DEBUG_non_redist on Windows (#26678) CI: Use LLVM's OpenMP over MSFT_DEBUG_non_redist on Windows Currently, we ship the non-redist debug version of microsoft's libomp.

vulkan: FA MMQ should use fp32 for Q quantization calculations (#27413) Codex found that qd could be a denorm and 1/qd would overflow. Website: https://llama.app Attestations: https://github.com/ggml-

mtmd: add --mmproj-device argument (#23255) feat: add --mmproj-device arg & backwards compatible MTMD_BACKEND_DEVICE env var feat: load mmproj device backend immediately, add -mmdev shortflag fix: its

metal : clamp K extent in tensor API mat-mat kernel for K not a multiple of 32 (#27450) The Tensor API mat-mat path of kernel_mul_mm (GGML_METAL_HAS_TENSOR) fed a static K=32 tile to the matmul2d op o

TP: enable tensor split for LFM2/LFM2MOE (#26993) Assisted-by: deepseek-v4-flash Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/42096995 macOS/iOS: macOS A

ci : run ccache-clear as the last step of release jobs (#27503) ci : run ccache-clear as the last step of release jobs Assisted-by: pi:llama.cpp/Qwen3.8-27B update disabled job too to force rebase Co-

model: use ggml_rope_set_offset() (#27382) model: use ggml_rope_set_offset() partially apply to deepseek2 Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/42

ggml: add ggml_rope_set_offset (+ metal support) (#27120) add params cpu kernel metal kernel add test backend ops gate other backends ggml: (cuda) support ggml_rope_set_offset (#27121) rm cuda support

model : GraniteSWAForCausalLM / GraniteMoeSWAForCausalLM (#25505) feat(convert): Add conversion for GraniteSWAForCausalLM Branch: GraniteSWAForCausalLM AI-usage: full (Bob, OpenCode + Qwen3.6-35b) Sig

vulkan: add null checks in ggml_vk_queue_command_pools_cleanup (#27353) Guard against null queue pointers. Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/4

vulkan : dequant q8_0 KV once in coopmat1 (#25494) vulkan : dequant q8_0 KV once in coopmat1 Assisted-by: Claude (Opus 4.8) vulkan : fall back instead of aborting when FA scratch exceeds maxStorageBuf

server: refactor sleep handling, allow access /metrics during sleep (#27376) add cached responses refactor on_sleeping_state allow accessing metrics during sleep metrics task should not reset timer up

ggml-cpu: gate __fp16 on __ARM_FP16_FORMAT_IEEE (#26860) ggml-cpu: gate __fp16 on __ARM_FP16_FORMAT_IEEE __ARM_NEON only signals NEON availability. The __fp16 type also needs the IEEE half format, imp

build : fix xcframework + cmake clean-up (#27304) xcframework : fix build mtmd : remove unused include path vendor : use vendor::hash alias target in cmake CMake reserves '::' in target names for impo

mtmd: fix LFM2 image tiling threshold (#27057) mtmd: fix LFM2 image tiling threshold refactor testing fix fix on windows Co-authored-by: Xuan Son Nguyen son@huggingface.co Website: https://llama.app m

ci : Update OpenVINO to 2026.3, skip nemotron-h rollback test (#27292) update to ov-2026.3, update device drivers ci: skip nemotron-h rollback test on OpenVINO The OpenVINO backend does not support SS

[SYCL] support OP OPT_STEP_ADAMW, OPT_STEP_SGD (#25268) fix conflict fix conflict of ops.md fix conflict of ops.md update the ops.md Co-authored-by: Neo Zhang Jianyu jianyu.zhang@intel.com Website: ht

sycl: fix thread/block count in quantized cpy kernel launches (#27160) Adjusts the thread/block count to be proportional to the size of the quant, reducing under/over subscription. Largest perf improv

ci : push release tag explicitly in release.yml (#27261) Add a 'Create and push git tag' step to the release job, right before the 'Create release' step. The tag is created with git tag and pushed wit

cuda : skip UMA override for HIP builds (#27083) AMD APUs report accurate memory via hipMemGetInfo. Using MemAvailable over-promises on small-carveout systems. fixes #18159 Website: https://llama.app

llama : check LoRA tensor data is within file bounds (#27056) llama : check LoRA tensor data is within file bounds Update src/llama-adapter.cpp Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@huggi

chat: refactor handling supports_string_content / supports_typed_content (#27130) better supports_string_content cap detect test: add 'skip' messages_inp_normalizer Website: https://llama.app macOS/iO

model : add support for MiniMaxText01ForCausalLM and MiniMaxM1ForCausalLM (#27018) llama : support for MiniMax-Text-01 model chore : renames to match the other MiniMax models model : add logits mask a

common: migrate the deprecated --mmap/--no-mmap to --load-mode (#26934) Replace the deprecated --mmap, --no-mmap, --mlock, and --direct-io flags with the unified --load-mode argument across scripts, e

vulkan: add SHMEM_STRIDE_PAD/APPLY_SLM_A_RESHAPE for coopmat1 on Intel Xe (#25380) vulkan: add SHMEM_STRIDE_PAD/APPLY_SLM_A_RESHAPE for coopmat mul_mm on Intel Xe vulkan: fix shmem estimate for Intel

common: support --models-dir loading MTP assistant models (#24431) common: support --models-dir loading MTP assistant models common: preset: check for MTP models with strict prefix common: preset: Tak

model: add Kimi-K3 text model (#26185) model: add Kimi-K3 text model Hybrid KDA (linear) + MLA (full) attention as in Kimi-Linear-48B, plus five things that architecture does not have: cross-layer res

dflash : clarify output logging of target_layer_ids (#27013) This commit tries to make the logging of target_layer_ids a bit clearer and easier to read. Currently the output generated looks like this:

sycl: fuse the gated-delta-net state writeback cpy (#26643) Port of #23940. Arc Pro B70, Qwen 3.6 27B Q4_K - Medium (48 of its 64 blocks run gated_delta_net), -ngl 99 -fa 1 -ctk f16 -ctv f16 -b 2048 -

sycl: fuse mul_mat(gate) + mul_mat(up) + GLU for q4_K dense FFN (#26779) Measured on Arc Pro B70 (Battlemage, Level Zero), llama-bench -r 20, two interleaved rounds, tg128: qwen2.5-3B-Instruct Q4_K_M

tests : replace personal home directory paths with generic placeholders (#27043) Scrub developer-specific /home// paths from example docs and test fixtures so they don't leak into the tree. examples/t

server: allow accessing /metrics and /slots during llama_decode() (#27041) server_queue::worker call llama_decode inside yield_to_queue also handle process_mtmd_chunk clean up nits rm test Website: ht

ggml : recurrent state rollback for ggml_ssm_scan (#26623) Initial changes for Recurrent state rollback for nemotron for cpu and cuda Removing CPU RS rollback. Will enable it in subsequent PRs additio

chat : pass reasoning_effort to template chat: add reasoning_effort to common_chat_templates_inputs Store OpenAI Chat Completions reasoning_effort and make it available to jinja templates (with model

ggml-hip : remove -funsafe-math-optimizations (#26696) It enables -fassociative-math, which reassociates FP reductions and can flip greedy argmax on RDNA3.5 (e.g. MTP speculative decode diverging from