b9305
Release b9305 was published on May 24, 2026 , featuring CMake UI build fixes and improvements for multiple platforms including macOS Apple Silicon and Linux architectures . The release provides prebui
Knowledge catalogue
Release b9305 was published on May 24, 2026 , featuring CMake UI build fixes and improvements for multiple platforms including macOS Apple Silicon and Linux architectures . The release provides prebui
Build b9239 is a llama.cpp release that includes a fix for the --fit verbosity flag when used with --verbosity 4 . The release provides compiled binaries for multiple platforms including macOS (Apple
b9240 is a release of llama.cpp that includes a fix for the --help option related to the --verbosity flag . The release provides prebuilt binaries across multiple platforms including macOS (Apple Sili
arXiv:2605.17898v1 Announce Type: new Abstract: Gaussian process (GP) inference in Python is dominated by libraries such as GPyTorch and GPflow, which are built on deep-learning frameworks and inherit
Apple is hoping that its record on privacy can be the differentiator on the AI front, and maybe even buy it a little slack as it continues to lag behind the competition. According to Bloomberg's Mark
Release b9186 of llama.cpp is a synchronization build of the GGML library , published May 16, 2026. The release includes pre-built binaries for multiple platforms including macOS (Apple Silicon and In
X (formerly Twitter) achieved the top ranking for news applications on the UK Apple App Store, according to a post from Elon Musk's account. This ranking reflects X's position among news-focused appli
Mythos, a security researcher or team, successfully exploited macOS security vulnerabilities in a five-day timeframe, demonstrating the relative speed at which determined actors can compromise Apple's
Lily Hay Newman / Wired: Foxconn says some of its North American factories suffered a cyberattack in recent days; ransomware group Nitrogen claims it stole 8TB of data — Famous for helping build Apple
An iOS application that enables large language models to run directly on-device using llama.cpp technology, allowing users to integrate their own Ollama instances for processing Apple HealthKit data t
Mark Gurman / Bloomberg: Sources: AirPods with cameras reached an advanced testing stage; the cameras will feed data to Siri to help answer questions, rather than take photos or video — Apple Inc. has
The post humorously references Apple's iMessage feature that displays group chats in green when they include non-iPhone users, joking that activating 'goblin mode' (a playful term for behaving mischie
Reuters: Tim Cook says iPhone sales, which slightly missed Q2 estimates, were held back by chip supply constraints, as “demand was off the charts” — Apple (AAPL.O) on Thursday reported results that be
Sarah Perez / TechCrunch: Lovable launches its AI coding app on iOS and Android, letting users code via voice or text AI prompts, and allowing them to switch between a PC and mobile — Apple's recent c
Lorenzo Franceschi-Bicchierai / TechCrunch: Citizen Lab details two spying campaigns that abuse weaknesses in the SS7 and Diameter protocols across 2G, 3G, 4G, and 5G networks to track people's locati
'Funny and distressingly realistic...propelled by awesome characters and inventive twists”— @andyweirauthor Silicon Valley invents the time machine in my upcoming book PARADOX INC, now available for p
Remember when Framework made the first laptop where you can easily upgrade its entire internal video card in three minutes flat? The company's getting into the external graphics game, too. As promised
Jake Rudnitsky / Bloomberg: A Blue Origin rocket failed to correctly place a BlueBird satellite from satellite networking company AST into its intended orbit; ASTS falls 14% pre-market — AST SpaceMobi
One of the most mortifying things about knowing a lot of techies is listening to them tell me excitedly about some very important discovery that they believe they have made. Recently, I ran into an ac
Anthony Capaccio / Bloomberg: The US Air Force cancels RTX's ground-control network for the US' next generation of GPS satellites after years of delays and cost overruns — The Air Force on Monday canc
Stunning views and just as jaw-dropping of presentations at the @cerebral_valley Gemma 4 Launch Party tonight! @vllm_project @UnslothAI @Ollama @huggingface @cactuscompute @apple @nvidia @pytorch and
Financial Times: Sources: China mobilizes multiple agencies to probe Meta's 2B Manus deal; some officials worry aggressive measures may send chilling signals to the tech sector — The landmark tech exi
Sarah Jacob / Bloomberg: ASML says South Korea surpassed China as its largest market in Q1 2026, with shipments hitting 45% of net system sales, or €2.84B, up from 22% in Q4 2025 — South Korea emerged
Alex Heath / Sources: Sources: a Snap-Perplexity AI search deal calling for Perplexity to pay Snap $400M has fallen apart; Snap is set to announce significant layoffs on Wednesday — Mass layoffs land
Well, how about that … ? 🤔 New: Apple and Google have directed users to dozens of nudifying apps, per new report. The apps, found by searching 'undress' or 'nudify,' have earned $122 million and were
This r/ollama community guide provides a practical breakdown of which AI language models (and combinations of models) can realistically fit within the unified memory constraints of common Apple Silico
Over 80% of enterprise data lives in unstructured form — PDFs, emails, reports, regulatory filings. Most of the time, such sources contain critical business information, yet they remain difficult to a
arXiv:2512.07833v2 Announce Type: replace-cross Abstract: Humans do not just see attribute similarity -- we also see relational similarity. An apple is like a peach because both are reddish fruit, but
Auto-generated index of all models mentioned across the wiki.
The Mac Mini M4 Pro with 48GB unified memory is a popular choice in the local AI community for running large language models via Ollama, as its Apple Silicon architecture makes all 48GB of RAM dire...
Ray Day Seattle (April 9, 2026) was an Anyscale event where ML engineers from Notion, Uber, Salesforce, and Apple shared real-world experiences scaling AI infrastructure with Ray. Notion highlight...
model: add Muse Spark Open (text, vision and audio) (#30616) model: add Muse Spark Open (text, vision and audio) Muse Spark Open is a latent space MoE: the residual stream stays at 8192 while the 256
mtmd: lightonocr does not require longest edge to always be 1540, native resolution is the default (#30600) Assisted-by: Codex Website: https://llama.app Attestations: https://github.com/ggml-org/llam
mtmd: add mtmd_audio_stream + support voxtral-realtime (#30629) mtmd: add mtmd_audio_stream + support voxtral-realtime address review Website: https://llama.app Attestations: https://github.com/ggml-o
hexagon: tensor repacking rework and support for tiled and flat quantized and fp weights (#30635) hex-repack: Remove need_repack hack and streamline the rules -- breaks GET_ROWS tests for K-Quants, wi
vulkan: fix gpu-visible host memory issues (#30468) vulkan: fix log spam if host pointer import fails exclude MoltenVK from shared memory import remove unreachable code, assert instead. Shorten warnin
tests : catch vanished rows in the fusion baseline (#30618) tests : update the Metal fusion baseline Re-record the MTL fusion baseline with the current build: 276 rows over 131 dummy models. Assisted-
ggml-cpu: refactor s309x repack helper functions (#30588) Signed-off-by: Aaron Teo aaron.teo1@ibm.com Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/566083
model : MTP support for Mellum2.1 (#30612) model : MTP support for Mellum model : inline rope construction in Mellum Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/atte
hexagon: correct HMX FA sinks (#30581) hexagon: correct HMX FA sinks hex-fa: vectorize sinks in hmx kernels Co-authored-by: Max Krasnyansky maxk@qti.qualcomm.com Website: https://llama.app Attestation
arXiv:2610.21297v1 Announce Type: new Abstract: Panoramic 3D reconstruction enables the holistic recovery of complete 360 ^irc scene geometry, offering significant benefits for robotics and AR/VR appl
ggml: fix conv_1d result layout for batched input (#28738) ggml: fix conv_1d result layout for batched input The GEMM behind conv_1d folds the batch into its rows, so the product sits in memory as [OL
ggml-cpu : size set_rows conversion buffer for all threads (#30454) ggml-cpu : size set_rows conversion buffer for all threads SET_ROWS is planned with n_tasks = 1, but every thread runs it and uses i
ggml-cpu : keep the FP16->FP32 lookup table on x86 with F16C (#30342) (#30343) ggml-cpu : keep the FP16->FP32 lookup table on x86 with F16C (#30342) #30270 routed both scalar conversions through F16C.
sycl: IQ3 code reorder (#29107) sycl: persistent IQ3_S/IQ3_XXS weight reorder for SYCL decode and prefill Add persistent reordered weight layouts for IQ3_S and IQ3_XXS. Weights are reordered once at l
opencl: support CLAMP on non-contiguous views (#30186) The clamp kernel indexed source and destination as one flat contiguous array, so a strided view as input (the new CLAMP v=1 case) read the wrong
spec : add lilicorr support (#30506) spec : add lilicorr support convert : use convention for hparam assignment add todo for hparam use in llama-batch.cpp Co-authored-by: Georgi Gerganov ggerganov@gma
server: save only restorable slot states to the prompt cache (#30498) server: save only restorable slot states to the prompt cache The idle-slot save loop stores every idle slot whenever a task starts
metal : add BF16 variant of the tensor API flash attention kernel (#30491) metal : add BF16 variant of the tensor API flash attention kernel cont : move tensor FA kernels to kernels/fa_tensor.metal We
vulkan : copy strided f16 KV once on AMD so reads spread across memory channels (#27703) vulkan : copy strided f16 KV once so reads spread across memory channels Assisted-by: Claude (Opus 4.8 / Opus 5
vulkan : fix concurrent first device init (#29766) vulkan : fix concurrent first device init tests : load models in parallel in test-thread-safety Loading them serially never exercised concurrent firs
models : add maion-coder (#29778) Add Support to maion-coder arch iAdd Support to support Draft models Address comments Remove maion context shift function Co-authored-by: Karthik Vijayan kavijay@micr
arXiv:2610.19129v1 Announce Type: new Abstract: Training from offline data has allowed for substantial progress in domains such as robotics, leading to general-purpose policies that can be easily appl
Eight U.S. states have filed lawsuits against OpenAI Group PBC, accusing the artificial intelligence startup of marketing an unsafe product in ChatGPT. The lawsuits filed by Iowa, Kansas, Nebraska, We
President Donald Trump posted a series of photos on Truth Social showing off renovations to the White House - but one of them appears to be modified with AI. The picture, which compares an old White H
chat: replace output string with parts (#30389) chat: replace output string with parts reserve first Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/5563975
server : escape the special tokens without std::regex (#30243) The d1-omni and kev prompts escape '<|name|>' in the request text with std::regex_replace. libstdc++ recurses for each char of the name,
webgpu: (Fix CI) fix mul_mat_id with duplicate expert ids (#30451) Fix mm-id of webgpu in the case of ids duplication formatting fix comments to avoid breaking up sentences in comments Website: https:
unicode : add opt-in NFC normalization for Unigram tokenizers (#30390) unicode : add opt-in NFC normalization for Unigram tokenizers Note: used help from Codex, Sol 6.1 Medium Fixing initial bot comme
models: drop the t_embd expand of the embedding graphs (#30461) These graphs only produce embeddings, and build_pooling() already expands its output for every pooling type, so the expand at the end of