Search: “ui”

vulkan: support sparse Flash Attention (#28105) vulkan: add sparse Flash Attention support for DSV4/GLM tune implementation add tests avoid nondeterministic atomicAdd add cm2 decode vector support sim

models : move build_arch_graph() after graph() template specialization (#28934) Move build_arch_graph()'s function definitions after the graph and graph template specializations have been explicitly d

cuda: support row-contiguous SUM_ROWS (#26308) cuda: support row-contiguous SUM_ROWS organize the code and add GGML_OP_MEAN to support row-contiguous tensors using the same shared kernel, and add a te

rpc : hash-cache only weights (#28789) rpc : hash-cache only weights ggml_backend_rpc_buffer_set_tensor and ggml_backend_rpc_set_tensor_async hashed every transfer above HASH_THRESHOLD and let rpc-ser

opencl: choose the MoE expert matmul by batch size for speculative decoding/MTP (#27637) opencl: gate the prebuilt q4_0 MoE GEMM on routing count opencl: stop writing zeros into the padded MoE activat

HIP: Enable AllReduce for ROCm (#27825) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/47762387 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon

hex-cpy: use dma if src and dst are contiguous (#28906) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/47770889 macOS/iOS: macOS Apple Silicon (arm64) macO

hexagon: add back missing contiguous fast-path and hvx_copy_uu for each run (#28886) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/47775478 macOS/iOS: mac

arXiv:2609.15078v1 Announce Type: new Abstract: Vibe design agents turn natural-language briefs into rendered interfaces and frontend code. Yet a useful design agent should do more than produce one va

arXiv:2609.13771v1 Announce Type: new Abstract: In this paper, I formulate a Continual Learning problem and propose a method named 'Homeostatic Continual Learning' that enables an AI agent to learn co

arXiv:2609.13718v1 Announce Type: cross Abstract: AI-powered gameplay support agents hold promise for game-based learning, yet grounding generative models in structured game data remains an open chall

ggml-cuda: fallback to F32 on device without BF16 hardware acceleration (#28846) ggml-cuda: fallback to F32 on device without BF16 hardware acceleration: (Nvidia >= AMPERE, AMD >= RDNA3 or = CDNA) app

common : move llama_n_rs_seq to before llama_decode (#28749) This commit moves the llama_n_rs_seq function call to before the llama_decode call and returns directly if the check is true, removing the

sycl : fix oneDNN scratchpad breaking the pool free order (#28704) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/47287268 macOS/iOS: macOS Apple Silicon (

ggml-cpu : disable PCH and fix CACHE_LINE_SIZE ambiguity to fix heap corruption (#28882) Disable the ggml-cpu precompiled header and remove the std::hardware_destructive_interference_size branch from

sycl: rfc: Use radix select for top_k (#28670) sycl: GPU-resident TOP_K for large k, parallelised over the device The SYCL backend refused GGML_OP_TOP_K above k = 32 and let it fall back to the CPU, a

llama.cpp : bump version to 0.4.1 (#28900) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/47376843 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silic

ci : add ubuntu-cuda builds to release (#28186) release : add ubuntu-cuda build job (12.8/13.3, x64+arm64) Add GCC 14 for CUDA arm64 builds in CI Eplicit bash Install git for CCCL fetch Install git be

HIP: fattn-mma: use fp32 accumulation on MFMA devices (#28576) use fp32 accumulators in fattn-mma on CDNA Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/47

common : implement common_schema internal representation for JSON schemas (#28736) common : implement common_schema types common : implement a json schema optimizer common : reduce optimizations commo

common: add LOG_JSON macro to log structured data (#28586) add LOG_JSON macro fit: add demo LOG_JSON Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/4711287

chat : improve parsing of complex types in qwen3-coder (#28742) chat : improve schema support in qwen3 parser cont : clean up grammar a bit Website: https://llama.app Attestations: https://github.com/

opencl: apply the noshuffle row-alignment rule to q4_K, q5_K and q8_0, not just q6_K (#28575) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/47132459 macOS

vulkan: workaround NV queuesubmit driver bug (#28830) There is a driver bug where two queues on the same VkDevice simultaneously submitting can break some internal synchronization. Until it's fixed, a

tests : reduce FA test sizes (#28842) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/47152933 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (a

sycl : Fix get mem error (#28227) fix for unsupport zes API optimize the code adjust the log level rm unused head files Update docs/backend/SYCL.md Co-authored-by: Titaniumtown titaniumtown@proton.me

ggml-cpu(s390x): guard VXE-only repack helpers (#28775) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/47190488 macOS/iOS: macOS Apple Silicon (arm64) macO

models : guard the expert FFN size fallback in nemotron-h against a zero divisor (#28779) The NextN/MTP tail loop derives the expert FFN size as n_ff/n_expert_used when expert_feed_forward_length give

tests : exclude HY_V4 from WebGPU test-llama-archs tests (#28855) Co-authored-by: Stanisław Szymczyk sszymczy@gmail.com Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/a

ggml-webgpu: Update to a recent version of Dawn (#28683) ggml-webgpu: Update to a recent version of Dawn No module scanning Accept review suggestion to update comment Co-authored-by: Masashi Yoshimura

hexagon: support for multi-device model split (aka row-split) (#28589) hex-row-split: add support for multi-device row spliting Co-authored-by: Max Krasnyansky maxk@qti.qualcomm.com hex-mdev: add work

webgpu: align tensor bindings to the type block size (#28382) Walk the binding offset back until the distance to the tensor is a whole number of blocks, so block quantized views get a valid element of

opencl: add bin kernel kernel_gemm_noshuffle_q4_k_f32_32b_trans_ila_a8_bin (#28677) opencl: add A8 Q4_K non-MoE binary kernel opencl: fix layout compatibility opencl: rename binary kernel selection he

opencl: fix several bugs where the backend aborts (#27630) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/47037447 macOS/iOS: macOS Apple Silicon (arm64) m

server: frame the router child state command as a whole line (#28747) The child writes its state commands on stdout while the logger writes on stderr, and both share a single pipe. The logger emits th

syscl : Handle (fail gracefully) unsupported tq1_0 quants (#28681) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/47043623 macOS/iOS: macOS Apple Silicon (

vendor : update cpp-httplib to 0.56.0 (#28787) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/47045738 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple S

ggml-cuda: hip add specific config table for AMD GCN (#27841) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/47052867 macOS/iOS: macOS Apple Silicon (arm64

server : allow model downloads at model limit fix issue #26809 (#28530) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/47055500 macOS/iOS: macOS Apple Sili

cmake: leave the timestamp out of precompiled headers on clang (#28816) Clang stores the modification time of the precompiled header sources inside the header and refuses the header when they differ.

jinja : support dot property integer literals (#28817) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/47107718 macOS/iOS: macOS Apple Silicon (arm64) macOS

Here's a neat thing I had ChatGPT Work with GPT-6 Astra (Max) do this morning: I live at <my address>. Figure out 5K and 10K running routes from me that loop from my house. Use OSM data. It worked for

arXiv:2609.10873v1 Announce Type: new Abstract: Independent evaluation can reject harmful policy updates yet also prevent useful continual learning. We argue that update admission must be assessed thr

opencl: add A8 Q4_0 mm binary kernel support (#28268) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/46774832 macOS/iOS: macOS Apple Silicon (arm64) macOS

vulkan: fix data race and OOB access in argsort(large) (#28705) argsort had a data race in the inner loop, which VVL caught. But I don't think this was causing failures in practice. argsort_large has

CUDA/HIP: Flash Attention tuning (gfx1201) (#28102) HIP: enable mma FA for head size 256 on RDNA4, tune configs Assisted-by: Claude Assisted-by: Codex HIP: prefer whole-tile FA grids over stream-k on