Search: “local-ai”

Release b9833 is a build of llama.cpp, an open-source project for LLM inference in C/C++. This release represents an incremental update within the llama.cpp development cycle, following the standard r

b9822 is a release of llama.cpp, a project for LLM inference in C/C++ . As a build version in the ongoing development sequence of the llama.cpp project, this release likely includes bug fixes, perform

The search results show information about other llama.cpp releases and the project generally, but do not contain specific details about release b9824. Based on the available information about llama.cp

b9825 is a release of llama.cpp, the C/C++ implementation for large language model inference . This build represents an intermediate version in the ongoing development of llama.cpp, part of the ggml-o

B9826 is a release of llama.cpp, an LLM inference project written in C/C++ . llama.cpp enables users to run large language models on consumer hardware without expensive GPUs or cloud infrastructure .

Release b9827 of llama.cpp, released on June 27, 2026, added a cudaMemcpy2DAsync fast path to ggml_cuda_cpy for improved CUDA tensor copying performance. When tensors are not fully contiguous but each

B9828 is a llama.cpp release featuring OpenCL flash attention improvements, including reworked FA kernels for f16 and f32, prefill prepass kernels, and FA kernels for q4_0 and q8_0 quantization format

b9810 is a release build of llama.cpp, an open-source software library that performs inference on various large language models such as Llama. The build identifier follows the project's versioning sch

b9811 is a release of llama.cpp , an open-source C/C++ project for running large language model inference. The release likely includes performance improvements, bug fixes, and optimizations to the cor

Based on available search results, I cannot find specific details about the b9814 release. However, b9814 is a build version identifier from the ggml-org/llama.cpp repository, which is a C/C++ impleme

B9816 is a release build number for llama.cpp, an open-source project that enables efficient large language model inference in C/C++ on consumer hardware. This release likely contains bug fixes, perfo

Release b9820 of llama.cpp introduces scheduler optimizations to reduce synchronizations during split compute and improves CUDA performance with fewer synchronizations between tokens. The update inclu

b9821 is the latest release of llama.cpp, a C/C++ implementation of LLM inference, which includes updates to allow the application to support --version, --licenses, and --help flags . Pre-built binari

b9786 is a release of llama.cpp, a tool for LLM inference in C/C++ . Llama.cpp is a free and open-source tool that allows users to run AI models locally on Windows, Linux, and macOS . The b9786 releas

B9787 is a build release of llama.cpp, an open-source C/C++ implementation for LLM inference created by Georgi Gerganov. The llama.cpp project enables large language model inference with minimal setup

Release b9789 of llama.cpp includes a fix for quantizing mixture-of-experts models with MTP (multi-token prediction) . Binaries are provided for multiple platforms including macOS, Linux, Android, and

Ollama v0.30.11 is a release candidate from the v0.30 series (June 2026) , which pairs the new MLX engine on Apple Silicon with continued llama.cpp improvements for enhanced compatibility across Mac a

The search results do not contain specific information about the b9777 release. Based on the available information about llama.cpp releases, b9777 is an intermediate build release from the llama.cpp p

Build b9784 is a release of llama.cpp, a C/C++ project that enables large language model inference with minimal setup on a wide range of hardware. The release includes pre-compiled binaries for multip

The search results do not contain specific details about the b9769 release. Based on the available information about llama.cpp and its release patterns, here is a knowledge base entry: Release b9769 o

Release b9770 of llama.cpp addresses server functionality by fixing remote preset handling and adding tests (PR #24938). The release includes pre-built binaries for multiple platforms including macOS,

llama.cpp release b9771 addresses Vulkan optimization by making mul_mm ALIGNED a spec constant, reducing shader variant explosion and binary size. This release is part of the ongoing development of ll

Release b9773 of llama.cpp adds Vulkan support for the GET_ROWS_BACK operation . The release includes pre-built binaries for multiple platforms including macOS, Linux, Windows, and Android with variou

The b9774 release of llama.cpp adds Vulkan backend support for multiple operations including SQR, SQRT, SIN, COS, CLAMP, LEAKY_RELU, and NORM functions, along with fixes for non-contiguous tensor hand

b9775 is a release of llama.cpp published on June 23, 2026 , featuring 'server: check draft context creation error' improvements . The release includes pre-built binaries across multiple platforms inc

B9755 is a release of llama.cpp, a tool for LLM inference in C/C++ . The release represents a specific build version in the active development of the project, continuing the iterative improvements to

Release b9756 fixes a crash in the server's edit_file function when appending at the end of a file, addressing a heap-buffer-overflow caused by improper handling of line_start -1. The fix normalizes t

Release b9760 of llama.cpp includes a server refactoring/generalization of the input file schema and wire-up of input_video with raw base64 support. The release includes multiple build variants across

The b9761 release of llama.cpp includes server improvements with model downloading moved to a dedicated process and real-time model load progress tracking via /models/sse endpoint. The release feature

b9763 is a release of llama.cpp, an open-source LLM inference project in C/C++ . The release includes built binaries across multiple platforms including macOS, Linux, Windows, Android, and openEuler,

Release b9752 of llama.cpp focused on refactoring batch construction in the server component (PR #24843) , implementing improvements to how inference batches are handled. The release includes builds f

Release b9753 fixes server progress reporting for loading speculative decoding models and adds a 'stages' list feature . This update includes improvements and optimizations for the llama.cpp server co

Release b9754 of llama.cpp implements an AC parser for stricter grammar generation in the common/peg module , with builds available across multiple platforms including macOS, Linux, Android, and Windo

llama.cpp release b9589 is a CUDA maintenance update that addresses data-race conditions in the ssm_scan_f32 kernel function by adding missing synchronization barriers for shared memory reuse. The rel

b9590 is a llama.cpp release that fixes the LFM2/LFM2.5 template handler which was ignoring json_schema from response_format . Released on June 10, 2026 , this build includes precompiled binaries for

The search results did not contain specific information about the b9592 release. Based on the available information, b9592 is a version release from the llama.cpp project, which is an LLM inference sy

Release b9572 of llama.cpp fixes a bug in the ggml-cpu rms_norm_back function that produced incorrect output under in-place aliasing conditions. The release includes multiple pre-built binaries for va

b9573 is a build release of llama.cpp, an open-source C/C++ project for LLM inference that aims to enable language model inference with minimal setup and state-of-the-art performance on various hardwa

Release b9577 of llama.cpp adds a --log-prompts-dir feature to the server that writes each prompt to a separate text file in a specified directory. The release was co-authored by Xuan-Son Nguyen and i

Release b9578 of llama.cpp includes a refactor of video subprocess handling in the mtmd (multi-threaded multi-device) component via pull request #24316 . The release provides prebuilt binaries across

b9580 is a llama.cpp release that adds v_dot2_f32_f16 support in matrix-matrix multiplication and Flash Attention via Vulkan, implementing support for Valve's fp16 dot2 extension. The release also inc

llama.cpp b9581 is a release that includes optimization for Vulkan backend memory usage, specifically reducing iq1 shared memory usage for mul_mm operations. Released on June 9, 2026 , this build prov

The search results don't contain specific information about release b9584. Based on the context from other llama.cpp releases in the results, b9584 is likely an intermediate build version of llama.cpp

Release b9585 of llama.cpp fixes granite speech model inference by applying embedding scale when deepstack is not used . The release was published on June 9, 2026, and represents a bug fix within the

This release updates the compute runtime version to 26.x within a Docker configuration for SYCL (Syclon Compute Language) support in llama.cpp. The change, addressed in pull request #24070, modernizes

llama.cpp is an LLM inference tool in C/C++ , and b9555 represents a specific build or version release from the ggml-org/llama.cpp GitHub repository. The project does not follow traditional release pr