Search: “ui”

server: fix speculation after an image (#28715) server: fix speculation after an image Pass the actual position to the drafter after an image, instead of the token count. Affects every drafter, not ju

model : fix MTP context kv cache allocation for deepseek2, glm4moe, … (#28630) model : fix MTP context kv cache allocation for deepseek2, glm4moe, cohere2moe architectures (#28626) model: add inverse

metal : fix idle threads in the remaining iq mul_mv kernels for ne00 < 1024 (#28692) metal : fix idle threads in the remaining iq mul_mv kernels for ne00 < 1024 Generalize the row split from #28086 to

metal : single-source fusion table + fusion debug rework (#28164) metal : rework fusion patterns into a single table All fusable op patterns for the Metal backend are now declared once in a fusion tab

cmake : skip PCH for llama-server PCH when using MSVC (#28763) This commit fixes an issue that I introduced when adding PCH (precompiled headers) in Commit 3bcfeb7 ('cmake : add PCH and unity build to

model: fix all granite family parameter counts (#28643) model: fix all granite family parameter counts Signed-off-by: Aaron Teo aaron.teo1@ibm.com model: fix additional include, add missing A prefix f

ggml-cpu(s390x): add Q1_0 vector intrinsic support (#28606) ggml-cpu: add ggml_vec_dot_q1_0_q8_0 support Signed-off-by: Aaron Teo aaron.teo1@ibm.com ggml-cpu: clean up variable naming for understandin

ggml-cpu(s390x): add repack support for q4_0 (#28667) ggml-cpu: clean comments Signed-off-by: Aaron Teo aaron.teo1@ibm.com Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cp

vulkan : add command-buffer debug labels for GPU profilers (#28101) vulkan : add command-buffer debug labels for GPU profilers Co-authored-by: gabby-zy z2262718160@gmail.com Assisted-by: Claude Code v

memory : avoid allocating V cache for indexer (it's not used) (#28330) Co-authored-by: Stanisław Szymczyk sszymczy@gmail.com Website: https://llama.app Attestations: https://github.com/ggml-org/llama.

vulkan: fall back to shared-memory reduction for dmmv on PowerVR (#28341) The Imagination proprietary Vulkan compiler returns VK_ERROR_UNKNOWN from vkCreateComputePipelines for every dequant mul_mat_v

tests : drop SYCL special-casing in test-backend-ops.cpp (#28688) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/46555010 macOS/iOS: macOS Apple Silicon (a

tests : increase tolerance for Add fusion tests (#28691) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/46565769 macOS/iOS: macOS Apple Silicon (arm64) mac

models: clean up some dead switch branches in old models (#28669) Some of these if statements were copypastaed in a former refactor and never cleaned up to remove the cases that could never happen any

spec: fix failed to decode mtmd chunk with DFlash (#28587) speculative: fix failed to decode mtmd chunk with DFlash When using DFlash w/ vision models, the drafter memory fails to allocate new tokens

ci : Update WoA CUDA 13.4 release to use 13.4.1 GA redistributables (#28687) Move Windows ARM64 CUDA 13.4 builds from the Developer Preview archives to the 13.4.1 GA redistributables Website: https://

vulkan: small M matrix optimizations for qwen (#28457) vulkan: optimize m=1 mul_mat by swapping A/B vulkan: Improve small M perf Allow split_k with small M. Make small vs med tile selection (for coopm

vulkan: use add_alloc_dep to enable topk_moe fusion for prefill (#28422) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/46661423 macOS/iOS: macOS Apple Sil

vulkan: use CPU writes in ggml_backend_vk_cpy_tensor_async if the context is idle (#28618) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/46709648 macOS/iO

mentria.ai is a browser inference engine I've been building solo, from scratch in WebGPU/WGSL. This week it crossed a milestone I had been chasing for a while: a 27B one-bit model answering at up to 3

Add IQ type handling for MoE (#28476) Co-authored-by: cwriter cwriter@localhost Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/46124981 macOS/iOS: macOS Ap

tests : use less threads for data initialization (#28325) tests : use 1 thread for data initialization cont : scale threads with number of elements cont : adjust Website: https://llama.app Attestation

vulkan: add f16 B-type matmul pipelines and warp tile size tuning for Intel coopmat1 (#27471) vulkan: add f16 B-type matmul pipelines and warp tile size tuning for Intel coopmat1 simplify mmp selectio

vulkan: add dedicated iq4_xs mat-vec shader (#28426) vulkan: add dedicated iq4_xs mat-vec shader Dedicated mul_mat_vec_iq4_xs for the dmmv path, replacing the generic fallback. ~+6-17% token generatio

jinja: treat a null left operand of in as a plain lookup (#28620) Templates that default an optional variable to none and then test its membership in a map hit an error, while the same expression is a

mtmd: propagate video ID to bitmap (#28601) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/46201259 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Sili

model: fix granite3 moe unknown parameter count (#28632) Signed-off-by: Aaron Teo aaron.teo1@ibm.com Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/4620980

args: officially deprecate --mmap|mlock|dio (#28334) Signed-off-by: Aaron Teo aaron.teo1@ibm.com Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/46228590 ma

CUDA: replace GGML_FA_ALL_QUANTS with GGML_FA_QUANTS, more control over what is compiled (#28079) CUDA: add configurable FA quant combinations Assisted-by: Codex remove all flags but , add runtime fal

CUDA: size routed MoE MMQ N-tiles from typical expert width on RDNA3 (#28552) Recreated from #24546 Co-authored-by: Carl Philipp Klemm carl@uvos.xyz CUDA: pick MMQ tile size against ncols_opt set on t

llama : use int32_t for llama_sampler_chain_n return type (#28631) Contributes to #4574 Co-authored-by: linsen linsen@insta360.com Website: https://llama.app Attestations: https://github.com/ggml-org/

vulkan: Convert FILL to distribute workgroups in 2D to avoid exceeding maxComputeWorkGroupCount (#28592) divide workload to 2D This is to workaround FILL exceeding maxComputeWorkGroupCount for Intel G

vulkan: use spec constant for matrix matrix multiplication A-type (#25773) vulkan: use spec constant for mul mat type_a vulkan: use map for mul_mm shapes cleanup fix indentation fix cm2 and shmem init

I’ve been using Qwen a lot recently and I’m honestly very impressed with it. For some of my tasks, Qwen seems to understand what I’m actually trying to achieve better than ChatGPT/GPT-5.6. I currently

arXiv:2603.04949v2 Announce Type: replace-cross Abstract: As web agents close the gap with humans on benchmarks, one question arises: Do today's agents perform just as well on tomorrow's web? We intro

hexagon: add RELU and LEAKY_RELU ops (#28585) hexagon: add RELU op hexagon: add LEAKY_RELU op too Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/45844223 m

model : support Kimi-K3 recurrent-state rollback (#28466) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/45866131 macOS/iOS: macOS Apple Silicon (arm64) ma

opencl: properly handle non-contiguous inputs to conv2d (#28503) opencl: fix conv2d non-contiguous strides opencl: format Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp

chat : split specialized parsers into common/parsers (#27764) chat : split specialized parsers into common/parsers Move the 14 dedicated template parsers out of chat.cpp into one file each under commo

Fix Vulkan-Hpp handle usage on 32-bit targets. (#22892) On 32-bit platforms, Vulkan non-dispatchable handles such as VkBuffer are represented as uint64_t, and Vulkan-Hpp disables implicit conversions

vulkan : fuse UNARY(GELU|SIGMOID|SILU|SOFTPLUS) + MUL (#27220) vulkan : fuse UNARY(SIGMOID|SILU|SOFTPLUS) + MUL vulkan : fuse UNARY(SIGMOID|SILU|SOFTPLUS) + MUL implement fusion in unary.comp behind U

llama : add missing headers (#28566) fix compile-error: add missing header Bug: #28557 Signed-off-by: Pepper Gray hello@peppergray.xyz fix compile-error: add missing header Bug: #28559 Signed-off-by:

metal : fix idle threads in mul_mv_iq3_xxs for ne00 < 1024 (#28086) metal : fix half-idle simdgroup in kernel_mul_mv_iq3_xxs_f32 for ne00 < 1024 metal : keep N_R0_IQ3_XXS = 4, dispatch a separate 8-ro

server : apply checkpoint min-step eviction only when the checkpoint list is full (#28302) The spacing eviction in create_checkpoint() keeps the oldest checkpoint and erases every later one within che

Revert 'ggml-cuda : restore prop.integrated on HIP builds (#24233)' (#28604) This reverts commit c7d8722. Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/46

llama: disable lazy tensor loading by default on iGPUs (#28326) llama: add lazy mode auto, fix iGPU regression revert changes except disabling lazy load on iGPUs in AUTO Website: https://llama.app Att