Search: “ui”

Hold right Ctrl, speak, release. faster-whisper (large-v3-turbo) transcribes on your own GPU, then qwen2.5:3b-instruct through Ollama cleans the text up: filler words out, punctuation in, spoken self-

local-air-ollama

8 Sept 2026

Content type

All Blog X Post Paper YouTube Reddit GitHub

Clear filters

Model Releases

Pathway’s brain-inspired architecture development on Amazon SageMaker HyperPod

DGX agent

Pathway's Baby Dragon Hatchling (BDH) is a brain-inspired, post-transformer architecture that reasons in latent space instead of emitting chain-of-thought tokens. See how Pathway develops and scales B

model-releasesaws-ml-blog

8 Sept 2026

b10831

vulkan: add TQ1_0 support (mm, mat-vec, mat-vec-id, dequant, get_rows) (#27765) vulkan: add TQ1_0 support (mm, mat-vec, dequant, get_rows) vulkan: pack TQ1_0 powers of 3 into a 32-bit constant Replace

b10833

vulkan: rms_norm fusion opportunities (#28024) Support RMS_NORM + MUL + ADD (+ MUL) and RMS_NORM + VIEW + SET_ROWS. Extend ROPE + VIEW + SET_ROWS to support IMROPE. Worth around 4% in gemma4 on my sys

b10834

ggml: allow backend inputs to not create another split (#28387) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/45674860 macOS/iOS: macOS Apple Silicon (arm

b10835

ggml-cuda: fix divergent barrier in f16 flash attention (#27870) ggml-cuda: fix divergent barrier in f16 flash attention ggml-cuda: avoid duplicate metadata pointer setup Website: https://llama.app At

b10837

caps : recheck typed content if template checks for string (#28511) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/45690927 macOS/iOS: macOS Apple Silicon

b10839

vulkan: support type-aligned GET_ROWS (#28253) vulkan: fall back to CPU for GET_ROWS with misaligned offsets The Vulkan GET_ROWS shader asserts when a tensor's backing-buffer offset plus view_offs is

b10840

CUDA: branchless Q4_K/Q5_K unpack to speed up mmvq, L2 prefetch on DGX Spark (#26705) Update Q4_K and Q5_K to use branchless computation, which stops the scale unpack being re-executed for every colum

b10842

ggml: add gfx90c HIP support (#26454) ggml: add gfx90c HIP support ggml: make gfx90c HIP support compliant with specifications Website: https://llama.app Attestations: https://github.com/ggml-org/llam

b10844

vulkan: add DeepSeek-V4 hyper-connection fused ops (DSV4_HC_COMB/PRE/POST) (#26578) vulkan: add DeepSeek-V4 hyper-connection fused ops (DSV4_HC_COMB/PRE/POST) CUDA has these ops from the DeepSeek-V4 m

b10850

tests : initialize the L2_NORM batch array (#28553) tests: bind the L2_NORM batch count to a local GCC cannot prove the loop fills norms up to the index read after it while the bound is a class member

b10821

metal : add remaining fa-vec tunings for M2 Max (#28458) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/45551940 macOS/iOS: macOS Apple Silicon (arm64) mac

b10823

common: add --log-jsonl (#28437) common: add --log-jsonl rename unknown to none Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/45560949 macOS/iOS: macOS Ap

b10825

grammar : fix max repetition threshold (#28469) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/45568343 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple

b10826

cuda: fixes races in mmid and mmf (#28475) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/45586039 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silic

b10827

opencl: properly choose weights pack for q4_K, q5_K mul_mat (#28402) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/45608946 macOS/iOS: macOS Apple Silicon

b10828

[Model] Support for Spark2_5ForCausalLM implementation (#27868) Add Spark3 Model rename spark3 -> spark2_5 Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@huggingface.co Co-authored-by: dongjiang d

b10829

models : fix GDN normalization from max to rsqrt (#28068) models: use flash-linear-attention's l2norm for gated delta net q/k The GDN q/k normalization is defined by flash-linear-attention as l2norm(x

b10830

convert : add --fuse-qkv flag to fuse Q/K/V into QKV during HF-to-GGUF conversion (#22780) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/45621954 macOS/iO

Agents

An agent for every citizen Engineers to upgrade our institutions Robots as a service for all $1 valuation for local individuals & institutio…

An agent for every citizen Engineers to upgrade our institutions Robots as a service for all $1 valuation for local individuals & institutions Market rates for everyone else Owns the last mile of inte

agentsemad-mostaque--x

b10817

sycl: attribute device allocations by site (GGML_SYCL_MEMTRACE) (#27631) define two new environment variables to better understand how much memory is being allocated, and when. This has been invaluabl

b10818

sycl : fix test-backend-ops CI break && restore Kronecker product FWHT support (#28016) (#28254) Reapply 'sycl : add Kronecker product FWHT support for sizes 384, 640, 768, 12…' (#28184) This reverts

b10819

metal : fix memory leak in early return (#28399) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/45438612 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple

b10794

SYCL: Refactor GGML_SYCL_ENABLE_MKL_FA to global var (#26863) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/45153754 macOS/iOS: macOS Apple Silicon (arm64

b10795

sycl: fuse rms_norm+mul+add and add+add residual chains (#27610) Fuse RMS_NORM+MUL+ADD and ADD+ADD under GGML_SYCL_ENABLE_FUSION. ADD+ADD uses the same binbcast indexing and type matrix as standalone

b10796

src : add n_expert_used_max function (#28323) src : add n_expert_used_max function With Commit c61b98b ('model: add NVIDIA Nemotron-3-Puzzle-75B-A9B (NemotronHPuzzle) support (#25444)') it is now poss

b10797

ggml-cpu(s390x) : fix q5_1 uninitialized v_acc (#28332) Signed-off-by: Aaron Teo aaron.teo1@ibm.com Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/45199911

b10798

common : make build info output stream configurable (#28322) Let llama_print_build_info write to a caller-provided FILE* instead of hardcoding stderr. The parameter defaults to stderr so existing call

b10809

llama.cpp : bump version to 0.4.0 (#28386) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/45314398 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silic

b10813

opencl: add Adreno xmem SDPA path (#26331) opencl: add Adreno xmem SDPA path Assisted-by: Codex Removed the Adreno-specific queue profiling override Clean up formatting 修复数值误差优化gqa/mask attn Assisted-

b10814

opencl: extend the elementwise and data‐movement op coverage (#27633) opencl: add extended elementwise unary ops (sgn, step, elu, hardswish, hardsigmoid, floor, ceil, round, trunc) Adds nine GGML_UNAR

b10816

metal : add remaining fa-vec tunings for M3 (#28396) addition of m3 in fa_vec_tuned_table adding q4_0,q4_1,q5_0,q5_1 in ggml-metal-tuning Fix formatting in ggml-metal-tuning.cpp Website: https://llama

b10770

metal : add fa-vec tunings for M3 (#28236) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/44857719 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silic

b10771

mtmd: add mtmd_tokenize_from_parts() (#28250) add mtmd_tokenize_from_parts use it in mtmd-cli move add_special to call level Website: https://llama.app Attestations: https://github.com/ggml-org/llama.

b10772

ggml-hexagon: add F16 support for unary ops (#28228) Extend the HTP backend's F16 unary op coverage to include ABS on top of the existing NORM/RMS_NORM/L2_NORM/SCALE/CLAMP/SQR/SQRT set. Add hvx_abs_f1

b10773

server : accept data: URLs for input_video and input_audio (#27735) server : accept data: URLs for input_video and input_audio input_video and input_audio passed accept_base64_uri=false to handle_medi

b10774

finetune: fix no KV cache (#27199) training: fix no KV cache apply @ ggerganov suggestion Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/44871971 macOS/iOS

b10775

mtmd: fix idefics3 preproc (#28273) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/44875193 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm

b10776

model: add NVIDIA Nemotron-3-Puzzle-75B-A9B (NemotronHPuzzle) support (#25444) hparams: add per-layer n_ff_exp/n_expert_used arrays with scalar-or-array loading G1/G2 infrastructure for variable-per-l

b10777

sycl: reduce redundant work in Q4_K multi-column MMVQ (#27062) sycl: Q4_K Weight unpack optimization and reuse between destination Columns sycl: Q4_K small N (N=2..4) + two output rows by subgroup reu

b10778

misc : prevent RAM peaking at model loading stage (#27483) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/44939788 macOS/iOS: macOS Apple Silicon (arm64) m

b10780

sycl : enhance the api to support peer-to-peer copy (#27550) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/44948405 macOS/iOS: macOS Apple Silicon (arm64)

b10781

vulkan: fix FA dequant path engagement (#28190) Skip the nb[3] check when ne[3] == 1, the shader never reads it for a single stream. Cache views carry the full-buffer stride there, so the old check re

b10782

CUDA: Allow concurrent streams per split for multi-GPU (#28198) CUDA: Allow CUDA optimization per split for multi-GPU. Previous guard caused multi-GPU to skip the graph optimization. The graph is alre

b10783

mtmd : add const in various places (#28307) mtmd : mark context as const in more methods Mark mtmd_context as const in: mtmd_bitmap_init_lazy mtmd_tokenize mtmd_tokenize_from_parts mtmd_helper_support

b10784

metal : fix glu dispatch with ne00 = 1 (#28306) metal : fix glu dispatch with ne00 = 1 tests : disable ill-defined tests Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/

b10785

metal : add sparse FA (#28098) metal : support n_kv_max sparse mask hint in flash attention vec kernel add kernel_flash_attn_ext_vec_idx: compacts finite mask entries into a per-row index list (Hillis