Search: “models”

chat : name tool and argument parser rules by index (#30088) bugfix: infinite recursion caused by a tool named 'call'(#29967) chat : use index for schema and argument rules tests : remove tests tests

chat: fix jinja parser for TranslateGemma (#30096) chat: fix jinja parser for translategemma log if missing soruce_lang_code or target_lang_code Website: https://llama.app Attestations: https://github

hexagon: improved GELU accuracy (#30104) Assisted-by: OpenCode Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/53797268 macOS/iOS: macOS Apple Silicon (arm6

hexagon: support tiled Q4_K and Q6_K GET_ROWS (#30115) hexagon: support tiled Q4_K GET_ROWS Assisted-by: OpenCode properly reject Q4_K views Assisted-by: OpenCode hexagon: support tiled Q6_K GET_ROWS

hexagon: Q6_K weight dequant speedup (#30121) hexagon: Q6_K weight dequant speedup Assisted-by: OpenCode unroll by another factor of 2 Assisted-by: OpenCode Website: https://llama.app Attestations: ht

hexagon: enable alloc_buffer_n (#30126) hex-bufs: add support for alloc_buffer_n hex-bufs: add support for splitting large tensors into separate buffers hex-bufs: update GGML_HEXAGON_MBUF to accept th

sycl: remove duplicate block-size defines from op headers (#29507) All were duplicates of the values in ggml/src/ggml-sycl/presets.hpp Website: https://llama.app Attestations: https://github.com/ggml-

sycl: add grouped MoE XMX GEMM (#29245) Co-authored-by: cwriter cwriter@localhost Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/53864714 macOS/iOS: macOS

sycl: fuse the delta-net alpha gate (add + unary + mul) (#29687) sycl: fuse the delta-net alpha gate (add + unary + mul) tests: cover the fused add + unary + mul chain sycl: give the fused alpha gate

CUDA: fix norm family kernels when ne[2]/ne[3] exceed grid dim limits (#28175) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/53919465 macOS/iOS: macOS App

cuda : Use byte strides for roll to allow non-contiguous ROLL operations (#29547) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/53926988 macOS/iOS: macOS

hex-mmadd: do not assume aligned read/write when bias-add is fused (#30133) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/53932639 macOS/iOS: macOS Apple

sycl: FWHT optimizations (#29605) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/53938516 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64

vendor : update cpp-httplib to 0.60.1 (#30134) Signed-off-by: Adrien Gallouët angt@huggingface.co Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/53949333 m

vulkan : fix TOP_K for +inf/NaN inputs and k = 1 on negative values (#30107) The bucket search in topk_nary_search.comp started from the range [0, 0xFF800000), which ends just below the ordered-uint m

llama: support MoE cache over multiple GPUs (#30112) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/53988921 macOS/iOS: macOS Apple Silicon (arm64) macOS A

CUDA: fix CCCL version guard breaking on major version rollover (#29453) CUDA: fix CCCL version guard breaking on major version rollover The guard compared the major and minor components independently

CUDA : looped PAD kernel for more than 65535 rows or slices (#30147) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/54006924 macOS/iOS: macOS Apple Silicon

CUDA: fix MMQ out-of-bounds reads (#29953) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/54029251 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silic

CUDA: improve top-k algorithm selection (#28713) CUDA: radix top-k for large row counts Replaces CUB's per-row DeviceTopKKernel with a grid-over-rows radix select, gated on GGML_CUDA_TOPK_RADIX_MIN_RO

Musa FWHT fix (#30167) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/54083178 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI

What's Changed server: proxy cloud usage and balance APIs by @drifkin in #18829 llama: fix clef head reads past 2GiB on windows by @Gigrise in #18777 cmd: remove account step from CLI onboarding by @h

When a legacy GGUF which requires our llama.cpp patch set is loaded, we do a lazy conversion on disk to make it llama.cpp compatible. To support downgrades, we temporarily hold both the new and old GG

ggml-webgpu: no dawn native features on wasi (#27069) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/53445261 macOS/iOS: macOS Apple Silicon (arm64) macOS

sycl: add IQ3_S multi-column MMVQ (#29500) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/53455527 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silic

vulkan: fix amd iGPU slow checkpoint read (#30049) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/53465294 macOS/iOS: macOS Apple Silicon (arm64) macOS App

ggml-webgpu: fix flash_attn supports_op check for overlapping KV (#28205) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/53548008 macOS/iOS: macOS Apple Si

imatrix : include clocale for std::setlocale (#30079) Co-authored-by: yarik dazzywi@github.com Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/53551657 macO

vendor : update cpp-httplib to 0.60.0 (#30081) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/53557265 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple S

musa: use the tile lightning indexer kernel (#30080) Signed-off-by: Xiaodong Ye xiaodong.ye@mthreads.com Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/535

vocab : add plamo fim tokens (#30090) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/53567889 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (a

sampling : use greedy selection for eligible temperature-zero chains (#29797) sampling : use greedy selection for eligible temperature-zero chains Assisted-by: OpenAI Codex Apply suggestion from @gger

metal : few-row MMA mat-mul for the remaining src0 types (#30065) The generic few-row MMA kernel works for any type with a 16-weight dequantizer, so it now also takes BF16, Q1_0, Q2_0, MXFP4, Q2_K, Q3

llama: fix k-pool scatter data race on shared sequences (#29994) llama: re-pool each shared k-pool rep once With shared cells every pool is re-pooled, and since the pooled keys are always scattered, t

llama : re-reserve the sched when the nextn extraction flags change (#30020) The speculative MTP init enables NextN extraction on the target and draft contexts after both were created and their schedu

ggml: fix CLAMP on non-contiguous views (CPU, CUDA) (#29517) ggml: fix CLAMP on non-contiguous views (CPU, CUDA) CUDA clamped ggml_nelements values flat and ignored the view strides. CPU addressed row

RPC: add -sm tensor (#26610) rpc: allow -sm tensor fix flush for apple rdma move graph_uids to rpc_dispatcher cont : fix conflict cont: stop spinning dispatcher thread remove meta backend change add T

opencl: fix OOB read in adreno xmem GEMM (#30041) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/53310534 macOS/iOS: macOS Apple Silicon (arm64) macOS Appl

vocab : implement PLaMo-3 tokenizer pre-segmentation (#30045) vocab : implement PLaMo-3 tokenizer pre-segmentation The PLaMo-3 tokenizer inserts hard boundaries before running the Unigram DP, around <

cuda : add BF16 support for XIELU (#29955) The XIELU CUDA kernel template is already generic over the element type; only the F32/F16 type assertion and the else-if dispatch were missing. Add the nv_bf

The secondary button gets its own look back and the chat add button its own light surface. Pressable elements get a pointer cursor again, the font rendering smooths on the app shell, the root layout r

llama: support both embd + raw tokens in batch (#29622) llama: support both embd + raw tokens in batch add to test-llama-archs also check case llm_arch_supports_mixed_batch = false constant graph topo

log, server: self contained colors, split child commands from logs in router mode (#29895) log, server: make router child lines carry their own colors The logger writes the color reset after the trail

CUDA: prefer whole-tile FlashAttention scheduling for efficient two-stage kernels (#29435) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/52707115 macOS/iO

CUDA: use MMVF for thin f16/bf16 mul_mat at small batch size (#29633) CUDA: use MMVF for thin f16/bf16 mul_mat at small batch size Signed-off-by: ynankani ynankani@nvidia.com adjust kernel selection l

metal : few-row MMA mat-mul (#29869) metal : few-row MMA mat-mul and batched copies for speculative decoding Speculative decoding verifies a few draft tokens per step. Without the tensor API, Metal ra