Search: “llm”

b8823 is a build release of llama.cpp, the C/C++ implementation for LLM inference that enables efficient language model execution locally and in the cloud. Based on the rapid development cycle of the

Build b8808 is an incremental release of **llama.cpp**, the open-source C/C++ library for running large language model (LLM) inference locally. Like all llama.cpp builds, it likely includes bug fixes,

b8811 is a release build from llama.cpp, a C/C++ library for LLM inference . The project releases multiple versions frequently as part of its rapid development cycle , with b8811 representing one of t

llama.cpp is a C/C++ library for LLM inference that enables running large language models on consumer hardware. Release b8814 is a specific version in the project's continuous release cycle, which fol

Build b8797 is a sequentially numbered incremental release of llama.cpp, the open-source C/C++ library for local LLM inference maintained by ggml-org on GitHub. As part of llama.cpp's rapid, continuou

**b8802** is a numbered incremental build release of [llama.cpp](https://github.com/ggml-org/llama.cpp), an open-source C/C++ framework for running large language model (LLM) inference locally and in

Build b8804 is an automated incremental release of [llama.cpp](https://github.com/ggml-org/llama.cpp), the open-source C/C++ framework for local LLM inference. Like all llama.cpp builds, it is trigger

**b8806** is a sequential build release of [llama.cpp](https://github.com/ggml-org/llama.cpp), an open-source C/C++ framework for running large language model (LLM) inference locally. Like other numbe

**b8807** is a sequentially numbered automated build release of [llama.cpp](https://github.com/ggml-org/llama.cpp), an open-source C/C++ framework for running large language model (LLM) inference loca

Build b8783 is a sequential incremental release of llama.cpp, the open-source C/C++ framework for running LLM inference locally and in the cloud. As with nearby builds in the b87xx series, it likely i

Build b8784 is a tagged release of llama.cpp, the open-source C/C++ library for efficient LLM inference maintained by ggml-org on GitHub. Like other incremental builds in the project's continuous rele

Build **b8786** is an incremental release of [llama.cpp](https://github.com/ggml-org/llama.cpp), the open-source C/C++ library for local LLM inference. Like other builds in the project's continuous re

Build b8787 is a tagged release of llama.cpp, an open-source C/C++ library for running large language model (LLM) inference locally or in the cloud with minimal setup. As with all llama.cpp builds, it

Build b8788 is an incremental release of llama.cpp, the open-source C/C++ framework for efficient LLM inference developed by ggml-org. Like other builds in the project's continuous release cycle, it l

Build b8790 is an incremental automated release of llama.cpp, the open-source C/C++ library for efficient LLM inference on local hardware. Like other builds in the project's continuous release cycle,

Build b8791 is an incremental release of llama.cpp, the open-source C/C++ library for local LLM inference maintained by ggml-org on GitHub. Like other numbered builds in the project's rapid release ca

Build b8793 is a tagged release of the llama.cpp project, an open-source C/C++ framework for running large language model (LLM) inference locally or in the cloud with minimal setup. As part of llama.c

Build b8794 is an incremental release of llama.cpp, the open-source C/C++ library for running large language model (LLM) inference locally. Like other builds in the project's continuous release series

**b8771** is a build release of [llama.cpp](https://github.com/ggml-org/llama.cpp), the open-source C/C++ library for running large language model (LLM) inference locally. Like other incremental build

Build **b8772** is a recent incremental release of [llama.cpp](https://github.com/ggml-org/llama.cpp), the open-source C/C++ library for local LLM inference. Based on surrounding release activity, it

Build b8775 is a specific incremental release of llama.cpp, the open-source C/C++ library for local LLM inference maintained under the ggml-org GitHub organization. Like other builds in its rapid, com

Build **b8777** is an incremental tagged release of the [llama.cpp](https://github.com/ggml-org/llama.cpp) project, a C/C++ library focused on enabling efficient LLM inference across a wide range of l

Build **b8778** is an incremental automated release of [llama.cpp](https://github.com/ggml-org/llama.cpp), the open-source C/C++ framework for running LLM inference locally and in the cloud. Like othe

llama.cpp build b8781 is the latest release of the open-source C/C++ LLM inference framework, published on April 13, 2026. Its primary change introduces a dedicated DeepSeek v3.2 chat parser along wit

**b8770** is a sequentially numbered automated build release of [llama.cpp](https://github.com/ggml-org/llama.cpp), an open-source C/C++ framework for running large language model (LLM) inference loca

llama.cpp build **b8751** is a tagged release of the [ggml-org/llama.cpp](https://github.com/ggml-org/llama.cpp) project, a C/C++ library enabling high-performance LLM inference with minimal setup ...

llama.cpp release **b8752** is a tagged build of the [ggml-org/llama.cpp](https://github.com/ggml-org/llama.cpp) project — a C/C++ framework for efficient LLM inference on a wide range of hardware....

llama.cpp release **b8754** is a tagged build of the open-source C/C++ LLM inference library maintained under the `ggml-org` GitHub organization. The release includes pre-built binaries for a wide ...

llama.cpp release **b8755** is a tagged build of the [ggml-org/llama.cpp](https://github.com/ggml-org/llama.cpp) project — a C/C++ library for local LLM inference. This build is one of the project'...

**b8757** is a versioned build release of [llama.cpp](https://github.com/ggml-org/llama.cpp), an open-source C/C++ framework for running large language model (LLM) inference locally on consumer hardwa

Build **b8759** is an incremental release of [llama.cpp](https://github.com/ggml-org/llama.cpp), the open-source C/C++ library for local LLM inference using GGUF-format models. Like other builds in th

llama.cpp release **b8760** is a build of the open-source C/C++ LLM inference framework, with its primary change being a tensor parallelism (TP) fix for Qwen 3 regarding next data split (PR #21732). P

Build b8761 is an incremental release of **llama.cpp**, an open-source C/C++ framework for running large language model (LLM) inference locally with minimal dependencies. Like neighboring builds in th

llama.cpp build b8763 is a release of the open-source C/C++ LLM inference library, published on April 11, 2025, with the primary change being a CUDA optimization to skip compilation of superfluous fla

llama.cpp release **b8740** (commit `e34f042`) is a build of the open-source C/C++ LLM inference engine focused on the change 'CUDA: fuse muls' (PR #21665), which optimizes CUDA performance by fusi...

llama.cpp **b8741** is an incremental build release of the open-source [llama.cpp](https://github.com/ggml-org/llama.cpp) project, which provides LLM inference in C/C++. It is one of many frequentl...

llama.cpp release **b8742** (commit `7b69125`) is a incremental build of the C/C++ LLM inference engine focused on a Vulkan backend enhancement: it adds Q1_0 quantization type support to `ggml-vulk...

llama.cpp release **b8744**, published on April 10, 2026, is a build of the ggml-org/llama.cpp C/C++ LLM inference engine. Its primary change enables the reasoning budget sampler for Gemma 4 by add...

llama.cpp release **b8747** is the latest build of the C/C++ LLM inference engine, published on April 10, 2026 (commit `fb38d6f`). Its primary change is a bug fix in the `common` layer that resolve...

llama.cpp release **b8739** is a build of the open-source C/C++ LLM inference engine that introduces HIP backend support for the CDNA4 (gfx950) GPU architecture, enabling hardware acceleration on A...

**v0.20.5-rc2** is a pre-release release candidate for the Ollama open-source local LLM runner (github.com/ollama/ollama), published around April 10, 2026, as part of the v0.20.5 release cycle. It ...

The no-cache path builds a [n_tokens, n_tokens] mask and passes K and V unpadded, so FLASH_ATTN_EXT sees K->ne[1] == n_tokens. The CUDA kernels for head size 512 require a multiple of FATTN_KQ_STRIDE,

llama : fix unexpected graph reallocation in the k-pool models (#29958) llama : fix unexpected graph reallocation in the k-pool models Both k-pool models built a graph shape that depends on state the

Add manifest-list storage so runner-specific manifests can coexist under one tag while preserving existing v1 tags as best-effort downgrade anchors. Show/list/copy/remove/pull/push now understand runn

What's Changed app: fix ChatGPT model selector spacing mlxrunner: Evict prefix cache snapshots from the active conversation mlxrunner: check system free memory and wait for evicted runners before load

qwen4exp: fix seq_cp, block position keying, mtmd input, cuda abort, add tests (#27941) qwen4exp: follow up fixes -kvu NaN collapse fix Assisted-by: Claude indexer cache ext.x/ext.y restore fix Assist