Search: “inference”

Build b8761 is an incremental release of **llama.cpp**, an open-source C/C++ framework for running large language model (LLM) inference locally with minimal dependencies. Like neighboring builds in th

llama.cpp build b8763 is a release of the open-source C/C++ LLM inference library, published on April 11, 2025, with the primary change being a CUDA optimization to skip compilation of superfluous fla

llama.cpp release **b8740** (commit `e34f042`) is a build of the open-source C/C++ LLM inference engine focused on the change 'CUDA: fuse muls' (PR #21665), which optimizes CUDA performance by fusi...

llama.cpp **b8741** is an incremental build release of the open-source [llama.cpp](https://github.com/ggml-org/llama.cpp) project, which provides LLM inference in C/C++. It is one of many frequentl...

llama.cpp release **b8742** (commit `7b69125`) is a incremental build of the C/C++ LLM inference engine focused on a Vulkan backend enhancement: it adds Q1_0 quantization type support to `ggml-vulk...

llama.cpp release **b8744**, published on April 10, 2026, is a build of the ggml-org/llama.cpp C/C++ LLM inference engine. Its primary change enables the reasoning budget sampler for Gemma 4 by add...

llama.cpp release **b8747** is the latest build of the C/C++ LLM inference engine, published on April 10, 2026 (commit `fb38d6f`). Its primary change is a bug fix in the `common` layer that resolve...

llama.cpp release **b8739** is a build of the open-source C/C++ LLM inference engine that introduces HIP backend support for the CDNA4 (gfx950) GPU architecture, enabling hardware acceleration on A...

ci: shorten Windows Vulkan build path Keep the nested shader-generator compiler probes below Windows path limits in checkouts with longer repository names. mlx: fix Nemotron bugs and support global sc

Overview llama.cpp v0.7.0 adds the LiliCorr speculative decoding technique and MTP for GLM5-Next, a new GPU cache for MoE experts kept in host memory (--moe-cache-mib, up to ~2.2x decode speedup when

The search results do not contain specific information about v0.32.0-rc0. Based on the version numbering and context from Ollama's release patterns, v0.32.0-rc0 is a release candidate for Ollama, a la

The search results don't contain specific details about release b9871. Based on the pattern evident in the search results and the context, here's the summary: B9871 is a release of llama.cpp, an open-

Based on the available search results, the specific release details for b9857 are not fully accessible, but this entry refers to a build release from the llama.cpp project. llama.cpp is a port of Face

The search results did not provide specific information about the b9564 release. Based on the context of llama.cpp releases and the pattern observed with nearby releases (b9542, b9543, b9544, etc.), I

The search did not return specific details about the b9547 release. Based on the repository context and release naming convention, b9547 is a build number for llama.cpp, an open-source C/C++ implement

The search did not return specific details about the b9535 release. Based on the available information, b9535 is an intermediate build version from the llama.cpp project, which is a C/C++ implementati

The search results don't contain specific information about release b9536, but I found related information about nearby releases in the llama.cpp project. Based on the pattern visible in the search re

The search results show general llama.cpp information and references to other recent builds (like b9484), but the specific details for b9487 were not clearly accessible. Based on the context from llam

B9466 is a build release in the llama.cpp project that includes fixes and improvements to speculative decoding functionality, specifically addressing n_outputs_max issues and extracting helper functio

The search results show recent llama.cpp releases but do not contain specific information about release b9467. Based on the context of llama.cpp releases and the GitHub repository structure, b9467 is

The search didn't return specific details about the b9388 release. Based on the available information about llama.cpp, this is likely a commit/release entry for the llama.cpp project. Here's a summary

b9414 is a release build of llama.cpp that includes improvements to CUDA PTX version checking , which helps prevent incorrect kernel dispatch on different GPU architectures. This build also adds suppo

The search didn't provide specific details about release b9365. Based on the GitHub repository pattern and context, b9365 is a build release of llama.cpp, which is a C/C++ implementation for enabling

b9240 is a release of llama.cpp that includes a fix for the --help option related to the --verbosity flag . The release provides prebuilt binaries across multiple platforms including macOS (Apple Sili

The search results show releases near b9143 (specifically b9134 was the most recent) but do not contain specific details about b9143 itself. Based on the available information: llama.cpp is a C/C++ im

I was unable to find specific details about the b9058 release. Based on the context, b9058 is a build version from the llama.cpp project, which is an open source software library that performs inferen

The search results show recent llama.cpp releases but not the specific b9015 release details. Based on the pattern found (b9010 is mentioned as the latest release from the search results), b9015 is li

B9022 is a release of llama.cpp created on May 4, 2026, with commit d8794ee signed with GitHub's verified signature. The llama.cpp project is the main playground for developing new features for the gg

The search results don't contain specific details about release b8952. Based on the information available, I can provide this knowledge base entry: b8952 is a release in the llama.cpp project, an open

The search results do not contain specific information about the b8920 release. Based on the available information, b8920 is a build version from the llama.cpp project, which is an open-source C/C++ i

The search did not return specific information about the b8922 release. Based on the available information about llama.cpp's release cycle and naming convention, b8922 is an intermediate build release

The search results don't provide specific details about the b8907 release. Based on the available information, here is the summary: b8907 is a release tag from the llama.cpp project, which is a C/C++

llama.cpp release **b8737** is a focused maintenance build that adds missing CUDA error handling to the ggml backend. Specifically, it checks the return values of NVIDIA CUB library calls used in t...

model : support Gemma4 DSpark draft backbone (#29226) dspark: add Gemma 4 draft support Add GGUF conversion and runtime support for full-attention and SWA Gemma 4 DSpark drafts, including tied output

Overview This release focuses on backend performance and correctness, broader model coverage, and more robust server/router operation. It adds HRM-Text (DFM Mimir 1B) support, MiMo-V2.6 and HunyuanOCR

The decode loop releases MLX's pool of freed buffers every 256 generated tokens, which is also how often the KV cache grows and drops its previous, smaller buffers. The check fires only when the token

vulkan: add TQ1_0 support (mm, mat-vec, mat-vec-id, dequant, get_rows) (#27765) vulkan: add TQ1_0 support (mm, mat-vec, dequant, get_rows) vulkan: pack TQ1_0 powers of 3 into a 32-bit constant Replace

Overview llama.cpp 0.4.0 adds initial Qwen3.8-Flash-Next and Nemotron-3-Puzzle support, on-demand tensor reading, per-slot server context limits, video input options, and a ggml update to 0.23.0 with

model: add Qwen3.8-Flash-Next (qwen4exp) (#27742) gguf: add qwen4exp (Qwen3.8-Flash-Next) arch and converter Adds the GGUF-side plumbing for HF model_type qwen4_exp: MODEL_ARCH.QWEN4EXP plus tensors f

What's Changed Models that don't set a repeat_penalty now default to 1.0 (off) instead of 1.1, matching other engines and speeding up speculative decoding; set a per-model parameter if an older model

sampler : remove 'full-context windows' from history-based samplers (#26524) Resolve -1 to 1024 instead of ctx-len for samplers Because of backend-sampling we initialize samplers before the complete l

DeepseekV4: reduce graph splits (#25702) macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu

The search results do not contain specific details about release b9938. However, based on the context available, b9938 is one of the regular build releases from the llama.cpp project. Llama.cpp releas

The search results show that b9946 is a specific release build tag from the llama.cpp project, though the exact details of that particular build are not visible in the page content retrieved. Based on

The search results don't contain specific details about the b9914 release. Based on the context of llama.cpp releases, b9914 is a build/commit version in the llama.cpp project, an open-source tool for

Release b9894 of llama.cpp was published on July 7, 2026 , and includes a Vulkan backend fix to check src0 type in GGML_OP_SET_ROWS to avoid failures due to unimplemented f16 support . Llama.cpp is th