AI Wiki — Knowledge Base

ToolOllama8 recent entries

30 Sept 2026Using AFM 3 PCC as an alternative to Local LLM

Apple Foundation Model 3 through Private Cloud Compute is directly available in macOS 27.2 through familiar AI clients. For Mac users running local models such as Qwen 3.x or Gemma 4, AFM 3 PCC is a c

2 Oct 2026I benchmarked Qwen 3.8 27B on my M4 Max — here's what I learned about local models, context, and coding performance

I've been experimenting with running larger models locally with Ollama, mainly because I'm interested in using them for agentic coding. I kept seeing benchmarks expressed as something like: 40 tokens/

3 Oct 2026Anyone using a local AI meeting notes setup instead of Fathom?

Meeting notes are one of the last parts of my workflow that still depend heavily on cloud tools. I've used Fathom and lately Bluedot. Bluedot works well for me because there's no meeting bot and I get

4 Oct 2026v0.40.0

What's Changed Models run on MLX on Apple Silicon by default In this release, on Apple Silicon devices, model architectures supported by the MLX runtime will automatically run on MLX. ollama pull qwen

8 Oct 2026I built a local server that speaks the Ollama API - sessions survive crashes, and your chat doesn't wait behind your agents

Disclosure first: I'm one of the maintainers, this is my project. If you've pointed Open WebUI or a script at a local server, you know the failure modes: the server restarts and every conversation is

9 Oct 2026I made a Mac app that uses your Ollama models to answer questions from your own folders, with the exact sentence cited

Disclosure: I'm the developer. The app is called Citenook. I wanted to ask questions across a few hundred PDFs and notes with Ollama, but every setup I tried either needed a lot of glue code or gave a

12 Oct 2026llama.cpp optimizations for specific hardware and models

I've made a few posts recently, just talking about the hardware I've got and the model I use. Pair of P100s, Unsloth Qwen3.6 35b A3B UD Q4 K XL. There's been a ton of talk of model and hardware specif

13 Oct 2026Built an open-source Cotypist/Granola hybrid: autocomplete on Gemma 4 E2B (~50 ms/suggestion on M4 Max) using your own meeting notes as context

I built a desktop app harness that keeps local meeting notes and can use them to autocomplete my typing as well as complement my dictation with additional context via reading my screen or using the pr

Search: “apple”

Tools