Model Releases
b11351
ggml : add alloc_buffer_n to buffer type interface (#23671) ggml : add alloc_buffer_n to buffer type interface Add alloc_buffer_n method to ggml_backend_buffer_type_i interface, with a public API ggml
ggml : add alloc_buffer_n to buffer type interface (#23671) ggml : add alloc_buffer_n to buffer type interface Add alloc_buffer_n method to ggml_backend_buffer_type_i interface, with a public API ggml_backend_buft_alloc_buffer_n. Default implementation in ggml-backend.cpp handles multi-buffer splitting and tensor allocation via ggml_tallocr Meta buffer type provides custom implementation that creates per-device sub-contexts and delegates to simple buffer types ggml_backend_alloc_ctx_tensors_from_buft now collects tensors into a list and delegates to the new API Remove temporary ggml_backend_meta_alloc_ctx_tensors_from_buft Add NULL alloc_buffer_n to all existing buffer type interfaces (cpu, metal, openvino, hexagon, webgpu, zdnn, virtgpu, repack) Assisted-by: llama.cpp:local pi cont : fix cur_buf_size init after flushing a buffer ggml : add TODO tag for shared buffer split logic Assisted-by: pi:llama.cpp/DeepSeek-V4-Flash-Vision-Exp tests : add alloc_buffer_n coverage Assisted-by: pi:llama.cpp/DeepSeek-V4-Flash-Vision-Exp cont : fix compile warnings tests : add descriptions for alloc_buffer_n tests Assisted-by: pi:llama.cpp/Qwen3.8-27B ggml : address review comments on alloc_buffer_n restore GGML_LOG_ERROR on buffer alloc / tensor init failure in the default impl (name the failing tensor) check the malloc result and drop the _impl indirection in ggml_backend_alloc_ctx_tensors_from_buft remove comments that restate the code fix the TAG_ALLOC_SHARED_BUFFER_SPLIT typo Assisted-by: pi:llama.cpp/Qwen3.8-27B ggml : add get_alloc_size_n to buffer type interface Add ggml_backend_buft_get_alloc_size_n public API Add optional get_alloc_size_n callback to ggml_backend_buffer_type_i Share tensor->buffer planning between alloc_buffer_n default and get_alloc_size_n default Replace unchecked realloc with std::vector in alloc_buffer_n default Make ggml_backend_alloc_ctx_tensors_from_buft_size use the new API Add test-alloc coverage for get_alloc_size_n Assisted-by: pi:llama.cpp/DeepSeek-V4-Flash-Vision-Exp cont : report malloc failure Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/52254232 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU) Ubuntu x64 (Vulkan) Ubuntu arm64 (Vulkan) Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries Ubuntu x64 (CUDA 13) - CUDA 13.4 libraries Ubuntu arm64 (CUDA 13) - CUDA 13.4 libraries Ubuntu x64 (ROCm 10.0) Ubuntu x64 (OpenVINO) Ubuntu x64 (SYCL FP32) Ubuntu x64 (SYCL FP16) Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Android: Android arm64 (CPU) Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide Windows: Windows x64 (CPU) Windows arm64 (CPU) Windows arm64 (OpenCL Adreno) Windows x64 (CUDA 12) - CUDA 12.4 DLLs Windows x64 (CUDA 13) - CUDA 13.4 DLLs Windows arm64 (CUDA 13) - CUDA 13.4 DLLs Windows x64 (Vulkan) Windows x64 (OpenVINO) Windows x64 (SYCL) Windows x64 (ROCm 10.0) openEuler: DISABLED openEuler x86 (310p) openEuler x86 (910b, ACL Graph) openEuler aarch64 (310p) openEuler aarch64 (910b, ACL Graph) UI: UI
Related
Source: llama.cpp Releases | 2026-10-02