Search: “ui”

common : read ngram cache parts by reference instead of copying (#30061) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/56620013 macOS/iOS: macOS Apple Sil

[SYCL]: fix memory errors in mul_mat, split buffer, host pool (#29889) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/56630304 macOS/iOS: macOS Apple Silic

model : MTP support for Mellum2.1 (#30612) model : MTP support for Mellum model : inline rope construction in Mellum Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/atte

hexagon: correct HMX FA sinks (#30581) hexagon: correct HMX FA sinks hex-fa: vectorize sinks in hmx kernels Co-authored-by: Max Krasnyansky maxk@qti.qualcomm.com Website: https://llama.app Attestation

common: honor HTTP_PROXY/HTTPS_PROXY env vars in http client (#21752) common: honor HTTP_PROXY/HTTPS_PROXY env vars in http client common_http_client() was ignoring standard proxy env vars, causing do

model : Granite Switch Decision (#30676) feat(convert): Add decision.chat to support decision models that can also chat Branch: GraniteSwitchDecision AI-usage: full (Claude + Sonnet 5.5) Signed-off-by

model: add Beam (Reflection) (#30670) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/56841237 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (a

Model: bartowski/Kwaipilot_KAT-Coder-V2.5-Dev-GGUF/Kwaipilot_KAT-Coder-V2.5-Dev-Q4_K_M.gguf Hosted via llamacpp on a potato(iGPU) and created in less than 10 minutes. Prompt given and was provided in

ggml : add note about mul_mat_id + disable mul_mat_id_dup tests (#30501) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/56058008 macOS/iOS: macOS Apple Sil

ggml: fix conv_1d result layout for batched input (#28738) ggml: fix conv_1d result layout for batched input The GEMM behind conv_1d folds the batch into its rows, so the product sits in memory as [OL

ggml-cpu : size set_rows conversion buffer for all threads (#30454) ggml-cpu : size set_rows conversion buffer for all threads SET_ROWS is planned with n_tasks = 1, but every thread runs it and uses i

ggml-cpu : keep the FP16->FP32 lookup table on x86 with F16C (#30342) (#30343) ggml-cpu : keep the FP16->FP32 lookup table on x86 with F16C (#30342) #30270 routed both scalar conversions through F16C.

sycl: IQ3 code reorder (#29107) sycl: persistent IQ3_S/IQ3_XXS weight reorder for SYCL decode and prefill Add persistent reordered weight layouts for IQ3_S and IQ3_XXS. Weights are reordered once at l

opencl: support CLAMP on non-contiguous views (#30186) The clamp kernel indexed source and destination as one flat contiguous array, so a strided view as input (the new CLAMP v=1 case) read the wrong

vulkan: Use L2-friendly workgroup scheduling for cm2 mulmat (#30215) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/56139256 macOS/iOS: macOS Apple Silicon

spec : add lilicorr support (#30506) spec : add lilicorr support convert : use convention for hparam assignment add todo for hparam use in llama-batch.cpp Co-authored-by: Georgi Gerganov ggerganov@gma

server: save only restorable slot states to the prompt cache (#30498) server: save only restorable slot states to the prompt cache The idle-slot save loop stores every idle slot whenever a task starts

metal : add BF16 variant of the tensor API flash attention kernel (#30491) metal : add BF16 variant of the tensor API flash attention kernel cont : move tensor FA kernels to kernels/fa_tensor.metal We

vulkan : copy strided f16 KV once on AMD so reads spread across memory channels (#27703) vulkan : copy strided f16 KV once so reads spread across memory channels Assisted-by: Claude (Opus 4.8 / Opus 5

vulkan : fix concurrent first device init (#29766) vulkan : fix concurrent first device init tests : load models in parallel in test-thread-safety Loading them serially never exercised concurrent firs

models : add maion-coder (#29778) Add Support to maion-coder arch iAdd Support to support Draft models Address comments Remove maion context shift function Co-authored-by: Karthik Vijayan kavijay@micr

sync : ggml Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/56327800 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DI

arXiv:2610.15084v1 Announce Type: new Abstract: Visual agents that interleave reasoning with tool invocation have posed a promising direction for multimodal tasks. However, learning effective tool inv

chat: replace output string with parts (#30389) chat: replace output string with parts reserve first Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/5563975

server : escape the special tokens without std::regex (#30243) The d1-omni and kev prompts escape '<|name|>' in the request text with std::regex_replace. libstdc++ recurses for each char of the name,

webgpu: (Fix CI) fix mul_mat_id with duplicate expert ids (#30451) Fix mm-id of webgpu in the case of ids duplication formatting fix comments to avoid breaking up sentences in comments Website: https:

unicode : add opt-in NFC normalization for Unigram tokenizers (#30390) unicode : add opt-in NFC normalization for Unigram tokenizers Note: used help from Codex, Sol 6.1 Medium Fixing initial bot comme

vulkan: fix compile error (#30495) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/55839699 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm6

models: drop the t_embd expand of the embedding graphs (#30461) These graphs only produce embeddings, and build_pooling() already expands its output for every pooling type, so the expand at the end of

opencl: fix q8_0 dp4a mul_mat_id and mark PREC_F32 mul_mat_id unsupported for adreno (#30365) opencl: fix min handling for moe q8_0 dp4a GEMM Co-authored-by: Hongqiang Wang wangh@qti.qualcomm.com open

opencl: use buf+offset instead of subbuffer for adreno moe expert sort (#30418) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/55971785 macOS/iOS: macOS Ap

jinja : write floats in tojson as Python does (#30362) tojson printed floats through a C++ stream (6 significant digits, no '.0'), so 48.858844 became 48.8588 and 1.0 became 1 in tool definitions, too

cuda : use SIMT implicit GEMM conv2d on AMD without WMMA (#30325) cuda : use SIMT implicit GEMM conv2d on AMD without WMMA Assisted-by: Claude Opus cuda : update conv2d SIMT comment cuda : skip SIMT c

ggml : improve RPC tensor transfer logs (#30481) add rpc_log_format_size() and print byte counts in KiB/MiB/GiB across the RPC client, server and transport traces add rpc_log_format_tensor() and inclu

hexagon: extend scalar DMA broadcasting support for binary ops (#30245) tests: cover weighted scalar broadcasts Assisted-by: OpenCode ggml : support extended scalar DMA binary ops Assisted-by: OpenCod

models : remove redundant ggml_cont calls now supported by all unary kernels (#30198) models: remove redundant ggml_cont calls now supported by CUDA unary kernels models: restore cont_2d after sigmoid

ggml-zdnn : introduce Q8_0 mat mul (#29836) ggml-zdnn: initial prototype of q8_0 matmul Signed-off-by: Aaron Teo aaron.teo1@ibm.com docs: update zdnn docs Signed-off-by: Aaron Teo aaron.teo1@ibm.com S

graph : avoid reallocations in the 'no cache' path (#30439) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/55354972 macOS/iOS: macOS Apple Silicon (arm64)

cuda : add GGML_CUDA_GRAPH_DEBUG and read env vars once (#30327) ggml-cuda: gate CUDA graph debug logs behind GGML_CUDA_GRAPH_DEBUG ggml-cuda: cache env var lookups in static const instead of re-readi

vulkan: allow multiple devices to access gpu-visible host memory (#29741) vulkan: allow multiple devices to access gpu-visible host memory clean up erroneous newlines add Windows support handle nullpt

tests : consolidate context state tests into test-llama-context (#30023) tests : consolidate the context state tests into test-llama-context test-save-load-state, test-recurrent-state-rollback and tes

graph: skip the LM head for pooled embeddings (#30445) graph: skip the LM head for pooled embeddings A context that extracts pooled embeddings outputs one vector per sequence, but every model still ex

model: load YaRN beta metadata for laguna models (#30331) Assisted-by: Codex Co-authored-by: Adam Caldwell accaldwell@users.noreply.github.com Website: https://llama.app Attestations: https://github.c

graph: pad the KQ bias of the no-cache attention (#30446) The no-cache attention pads K, V and the mask to 256, but T5 also adds a relative position bias of [n_tokens, n_tokens], so the add with KQ fa

hexagon: add configurable HTP DCVS/HMX power mode (#30423) hexagon: add configurable HTP DCVS/HMX power mode hexagon: address PR review feedback (drop CLI flag, align QAIRT power modes, comment/log cl

meta: recreate all subgraphs when the arena is reallocated (#30453) meta: recreate all subgraphs when the arena is reallocated chore: revert added test cases Website: https://llama.app Attestations: h