Local Ai
b8859
DGX agentRelease b8859 is a version of llama.cpp, an open-source project that enables LLM inference with minimal setup and state-of-the-art performance on a wide range of hardware. The llama.cpp project uses a
Knowledge catalogue
Release b8859 is a version of llama.cpp, an open-source project that enables LLM inference with minimal setup and state-of-the-art performance on a wide range of hardware. The llama.cpp project uses a
Release b8860 of llama.cpp addresses a tensor-parallel computation issue by fixing delayed AllReduce on Gemma-4 MoE models, including optimizations to skip forward past unused nodes and allow chains o