Search: “inference”

B9048 is a build/release of llama.cpp, an open-source C/C++ implementation for running large language model inference. The release includes optimizations and improvements to the core llama.cpp softwar

B9028 is a release build from the llama.cpp project, which provides LLM inference in C/C++. The llama.cpp project uses sequential build numbers (like b9028) to track intermediate releases of its LLM i

llama.cpp enables LLM inference in C/C++ , and release b9014 represents a build revision or commit snapshot from the llama.cpp repository on GitHub. This release would include bug fixes, feature impro

B9018 is the latest version of llama.cpp released on May 4, 2026. Llama.cpp is a project for LLM inference in C/C++ , providing efficient large language model execution with broad hardware support inc

b9019 is a release of llama.cpp, a C/C++ implementation for LLM inference. As a release tag from the ggml-org/llama.cpp repository, it represents a specific commit or version of the project that inclu

b9020 is a build release of llama.cpp (a C/C++ implementation of LLM inference) released on May 4, 2026, with precompiled binaries available for multiple platforms including macOS, Android, OpenEuler,

b9025 is a release from llama.cpp, a C/C++ project for LLM inference . The release uses a build numbering system for intermediate versions of the library. As a llama.cpp release, it likely includes up

b9012 is a build version from the llama.cpp GitHub repository, which is an LLM inference implementation in C/C++ . The release likely contains updates, bug fixes, and improvements to the llama.cpp inf

llama.cpp is an LLM inference framework in C/C++ that enables efficient local execution of large language models. Build b9004 is a recent release with optimizations and improvements for supporting var

b9010 is a build release of llama.cpp, an open-source project for LLM inference in C/C++ . As a numbered build tag in the llama.cpp release system, it represents a specific development build containin

llama.cpp is a C/C++ implementation that enables LLM inference with minimal setup and state-of-the-art performance on a wide range of hardware locally and in the cloud. Release b8995 is a build/versio

b8981 is a release version of llama.cpp, a C/C++ implementation for LLM inference . Build versions in llama.cpp releases typically contain updates to the underlying ggml library, performance optimizat

b8957 is a release of llama.cpp that includes spec parameter refactoring changes , featuring modifications to parameter handling and model specifications. The llama.cpp project enables LLM inference w

b8958 is a release of llama.cpp, a C/C++ library for LLM inference . The project uses rapid release cycles with frequent version tags tracking incremental updates and improvements to the codebase. Thi

llama.cpp b8967 is an intermediate build release of llama.cpp, a C/C++ implementation for LLM inference with minimal setup and state-of-the-art performance. The project follows a rapid release cycle w

This release adds OpenCL GPU acceleration support for the IQ4_NL quantization format in llama.cpp, enabling more efficient inference of quantized language models on compatible hardware. IQ4_NL is a 4-

b8940 is a build release of llama.cpp, an open-source C/C++ library for LLM inference that enables running large language models locally with minimal setup and high performance. This intermediate buil

b8909 is an intermediate build release of llama.cpp, reflecting the project's practice of publishing multiple releases in a single day . llama.cpp is a C/C++ implementation enabling LLM inference with

B8924 is a release build number from the llama.cpp project, a C/C++ framework for efficient large language model inference on consumer hardware. The llama.cpp project publishes multiple releases in a

B8925 is an intermediate build release of llama.cpp, the C/C++ library for efficient large language model inference. Llama.cpp releases follow a continuous build cycle rather than traditional versioni

B8902 is a release build of llama.cpp, an open-source C/C++ framework for running large language model inference on consumer hardware with minimal dependencies. As an intermediate build release from t

B8905 is a build release of llama.cpp, an open-source C/C++ library for large language model inference optimization. The release follows the project's rapid development cycle with frequent intermediat

b8882 is a release of llama.cpp, a C/C++ implementation for LLM inference . The project follows a rapid release cycle with frequent updates to support multiple hardware architectures and platforms. Th

b8883 is a release build of llama.cpp, an open-source software library that performs inference on various large language models, co-developed alongside the GGML tensor library. This intermediate build

llama.cpp is a C/C++ implementation that enables LLM inference with minimal setup and state-of-the-art performance on a wide range of hardware locally and in the cloud. Release b8884 is a build/versio

b8864 is a build release of llama.cpp, an open-source C/C++ library for large language model inference. The project uses rapid release cycles with frequent build tags published as intermediate develop

B8871 is a build release of llama.cpp, an open-source C/C++ implementation for LLM inference. Build releases in the llama.cpp project use alphanumeric identifiers and represent incremental development

b8872 is a release tag from llama.cpp, a project that enables LLM inference in C/C++ . The release represents a specific commit or version update to the llama.cpp codebase. Without access to the speci

b8874 is a release from llama.cpp, a C/C++ library for LLM inference. The llama.cpp project publishes multiple releases in a single day, and b8874 represents an intermediate build version containing u

B8852 is a release of llama.cpp, an LLM inference library in C/C++ . This build tag likely contains bug fixes, performance improvements, and feature updates from the llama.cpp development cycle, which

Release b8859 is a version of llama.cpp, an open-source project that enables LLM inference with minimal setup and state-of-the-art performance on a wide range of hardware. The llama.cpp project uses a

b8842 is a release of llama.cpp, a C/C++ implementation for LLM inference. The llama.cpp project publishes multiple releases in a single day as part of its active development cycle. This specific rele

b8823 is a build release of llama.cpp, the C/C++ implementation for LLM inference that enables efficient language model execution locally and in the cloud. Based on the rapid development cycle of the

Build b8808 is an incremental release of **llama.cpp**, the open-source C/C++ library for running large language model (LLM) inference locally. Like all llama.cpp builds, it likely includes bug fixes,

llama.cpp is a C/C++ library for LLM inference that enables running large language models on consumer hardware. Release b8814 is a specific version in the project's continuous release cycle, which fol

Build b8797 is a sequentially numbered incremental release of llama.cpp, the open-source C/C++ library for local LLM inference maintained by ggml-org on GitHub. As part of llama.cpp's rapid, continuou

Build b8784 is a tagged release of llama.cpp, the open-source C/C++ library for efficient LLM inference maintained by ggml-org on GitHub. Like other incremental builds in the project's continuous rele

Build **b8777** is an incremental tagged release of the [llama.cpp](https://github.com/ggml-org/llama.cpp) project, a C/C++ library focused on enabling efficient LLM inference across a wide range of l

**llama.cpp release b8750** is a tagged build of [llama.cpp](https://github.com/ggml-org/llama.cpp), the open-source C/C++ inference engine for large language models maintained under the ggml-org G...

llama : report compute graph reallocations during inference (#30329) Add an optional ggml_backend_sched_realloc_callback that user code registers with ggml_backend_sched_set_realloc_callback to be not

What's Changed llama: update llama.cpp to b11521 for decision models and EmbeddingGemma 2 by @jmorganca in #18917 server: reuse verified manifests and loaded models in inference routes by @dhiltgen in

ggml-openvino: update to 2026.4.1, optimize performance, expand ops, improve device listing. (#29852) ggml-openvino : Qwen3.5 MoE perf (#312) Squash of ravi9#312: ggml-openvino: add detailed inference

vulkan: tune mat-vec rows for batched inference on Strix Halo (#27909) vulkan: RDNA3 static mat-vec rows above four columns On RDNA3 above four columns a static 4 rows for all types benches faster tha

common : auto-detect spec type from draft GGUF metadata (#26814) common : auto-detect spec type from draft GGUF metadata When -md loads a local draft model without --spec-type, the sidecar inference i

ci : onboard AMD ROCm CI with gfx1151 fixes (#26544) ci: prepare for amd rocm ci Signed-off-by: Aaron Teo aaron.teo1@ibm.com ci: fix editorconfig-checker Signed-off-by: Aaron Teo aaron.teo1@ibm.com ci

b9949 is a release build of llama.cpp, the open-source C/C++ inference engine for running large language models locally. llama.cpp releases are published frequently with build versions in the b-series