Search: “models”

v0.22.1-rc1 is a pre-release version of Ollama that includes improvements to MLX sampler batching, tokenizer BPE offset handling, NVIDIA TensorRT Model Optimizer support, and fixes for desktop app sta

Release b8946 includes a fix to remove duplicate wo_s scale after build_attn for Qwen3 and LLaMA models , along with other improvements to the llama.cpp library. This is an intermediate build release

This release adds OpenCL GPU acceleration support for the IQ4_NL quantization format in llama.cpp, enabling more efficient inference of quantized language models on compatible hardware. IQ4_NL is a 4-

Release b8855 addresses a crash in llama-tokenize when using the vocab_only flag with GLM-DSA models and fixes a crash in print_info for GLM-DSA when vocab_only is set. This is a bugfix release for th

b8840 is a release version of llama.cpp, a C/C++ implementation for large language model inference. This release build includes compiled binaries and updates for various platforms and hardware acceler

b8829 is a release build of llama.cpp , a C/C++ framework for running large language models locally. Notable in this release was a significant size difference compared to the preceding build b8828 , t

Build b8808 is an incremental release of **llama.cpp**, the open-source C/C++ library for running large language model (LLM) inference locally. Like all llama.cpp builds, it likely includes bug fixes,

Build **b8799** is an incremental release of [llama.cpp](https://github.com/ggml-org/llama.cpp), the open-source C/C++ framework for running large language model inference locally and in the cloud. Li

**b8806** is a sequential build release of [llama.cpp](https://github.com/ggml-org/llama.cpp), an open-source C/C++ framework for running large language model (LLM) inference locally. Like other numbe

Build **b8795** is an incremental release of [llama.cpp](https://github.com/ggml-org/llama.cpp), the open-source C/C++ framework for running large language model inference locally and in the cloud. Li

Build **b8779** is an incremental release of [llama.cpp](https://github.com/ggml-org/llama.cpp), an open-source C/C++ framework for running large language model inference locally and in the cloud. Lik

Build b8766 is a numbered incremental release of llama.cpp, the open-source C/C++ framework for running large language model inference locally. Like other builds in its rapid release cycle, it likely

**b8770** is a sequentially numbered automated build release of [llama.cpp](https://github.com/ggml-org/llama.cpp), an open-source C/C++ framework for running large language model (LLM) inference loca

Ollama v0.20.6-rc1 is a pre-release candidate for the v0.20.6 update to Ollama, the open-source framework for running large language models locally. Based on the associated v0.20.6 pre-release notes,

The search results did not return the specific changelog details for build b8756. Based on what is available and the general context of llama.cpp's rolling release model, here is a factual summary ...

Ollama v0.20.5-rc0 is a release candidate for the v0.20.5 version of the Ollama open-source project, which enables users to run large language models locally. The stable v0.20.5 release that follow...

What's Changed mlx: port the Metal custom kernels to CUDA by @dhiltgen in #18657 docs: model recs and language standardization by @anra8571 in #18981 openai: accept custom tool calls in Responses hist

The no-cache path builds a [n_tokens, n_tokens] mask and passes K and V unpadded, so FLASH_ATTN_EXT sees K->ne[1] == n_tokens. The CUDA kernels for head size 512 require a multiple of FATTN_KQ_STRIDE,

**Release Summary – v0.32.15 (GitHub Release)** Version 0.32.15 was published on **19 Aug**, adding a *model metadata cache* to reduce per‑request overhead in Ollama. The release builds on the previou

Learn how to write your first prompt in the GitHub Copilot app, choose the right context and model, and start your first task with confidence. The post Write your first prompt with the GitHub Copilot

What's Changed x/create: quantize lm_head at 8-bit in the requested family by @jessegross in #17357 test: harden flaky updater and transfer unit tests by @dhiltgen in #17378 server: fix ps data race o

Copilot now bills usage at listed API rates. Compare direct model access with the coding workflow, policy, and harness work around it. The post Copilot vs. raw API access: What are you actually paying

b9948 is a build release of llama.cpp, an open-source C/C++ project for efficient large language model inference. The project ships continuous build-tagged releases using a build numbering system rath

b9945 is a build-tagged release of llama.cpp, an open-source library that performs inference on large language models and is co-developed alongside the GGML tensor library. The llama.cpp project does

llama.cpp is an open-source software library that performs inference on various large language models , and the project ships continuous build-tagged releases rather than traditional semantic versioni

Based on available information, b9910 is a release tag from the llama.cpp project, an open-source C/C++ implementation for running large language model inference locally on consumer hardware. Llama.cp

b9913 is a build-tagged release from llama.cpp, an open-source software library that performs inference on various large language models. The project does not use traditional semantic versions; instea

Based on available information, b9931 is a release of llama.cpp, which is an open-source project for large language model inference in C/C++. As a commit-based release from the ggml-org/llama.cpp repo

b9933 is a continuous build-tagged release of llama.cpp , the C/C++ inference engine for running large language models locally. This release represents an incremental update in llama.cpp's development

Release b9895 of llama.cpp includes a fix for speculative inference out-of-bounds read in ngram-map on prompt shrink, with ~2x performance gains in PP_Speed for FP32, Q4_0 and Q8_0 models. The release

b9879 is a release build identifier in the llama.cpp project, a C/C++ implementation of Meta's LLaMA language models. This release likely contains bug fixes, performance improvements, and feature upda

B9885 is a build-tagged release of llama.cpp, an open-source C/C++ inference engine for running large language models locally. The project does not use traditional semantic versions; instead it ships

b9891 is a build release of llama.cpp, the open-source C/C++ inference engine for running large language models locally. This release enables LLM inference with minimal setup and state-of-the-art perf

Release b9892 is a version identifier for llama.cpp, an open-source C/C++ framework for running large language model inference on consumer hardware. This specific build (b9892) represents a snapshot o

llama.cpp b9876 is a build-tagged release from the llama.cpp project , a pure C/C++ implementation of large language model inference . The project enables LLM inference with minimal setup and state-of

Release b9852 is a build version of llama.cpp, a C/C++ implementation that enables large language model inference with minimal setup and state-of-the-art performance across diverse hardware platforms

Release b9858 is a continuous build-tagged release of llama.cpp , the open-source C/C++ project that enables large language model inference with minimal setup and optimized performance across diverse

Release b9850 is a version of llama.cpp, an open-source software library for large language model inference developed alongside the GGML tensor library. This release likely includes updates, bug fixes

b9840 is a release of llama.cpp, a tool for LLM inference in C/C++. The release enables running AI models locally on Windows, Linux, and macOS. This specific build tag likely contains bug fixes, perfo

Build b9829 is an intermediate release of llama.cpp, the open-source C/C++ project that enables users to run large language models on consumer hardware without expensive GPUs or cloud infrastructure.

llama.cpp b9830 is a release of the open-source LLM inference project enabling local language model execution with minimal setup . The release likely includes backend improvements and optimizations fo

B9826 is a release of llama.cpp, an LLM inference project written in C/C++ . llama.cpp enables users to run large language models on consumer hardware without expensive GPUs or cloud infrastructure .

b9811 is a release of llama.cpp , an open-source C/C++ project for running large language model inference. The release likely includes performance improvements, bug fixes, and optimizations to the cor

b9786 is a release of llama.cpp, a tool for LLM inference in C/C++ . Llama.cpp is a free and open-source tool that allows users to run AI models locally on Windows, Linux, and macOS . The b9786 releas

B9787 is a build release of llama.cpp, an open-source C/C++ implementation for LLM inference created by Georgi Gerganov. The llama.cpp project enables large language model inference with minimal setup

Release b9789 of llama.cpp includes a fix for quantizing mixture-of-experts models with MTP (multi-token prediction) . Binaries are provided for multiple platforms including macOS, Linux, Android, and