Knowledge catalogue
This post documents a 10-day project to build a local AI system using open-source tools and models, specifically combining Ollama (a local LLM framework), Gemma 4 (a language model), Claude Cowork 3P,
Hermes Agent provides a migration tool that imports OpenClaw setups into Hermes. The tool migrates your persona, memory, skills, configs, and API keys in a single command. The guide covers what gets m
Sentinel is a local-first AI coding desktop application built with Rust and Tauri that automatically routes coding tasks to appropriate models based on task complexity. Instead of swapping between mul
An open-source locally-run conversational AI that moves beyond simple request-response models by implementing persistent memory, belief, and self-reflection. The system stores all user profiles, memor
This post benchmarks three Qwen3.6 model variants against gpt-oss:120b when running on Apple Silicon hardware, evaluating their performance characteristics and practical usability. It documents both t
Ollama Cloud launched in September 2025 with fixed-price subscription tiers (20/month Pro, 100/month Max) for cloud-hosted inference , while local deployment remains free with unlimited local usage .
Ollama's MLX engine runs on NVIDIA GPUs via CUDA v13 on Windows and Linux. Users have reported that Ollama crashes on RTX 3060 with cuda_v13 in versions 0.13.0 through 0.15.6, while deleting the cuda_
Aura is a local-first AI daemon that enhances tools with persistent memory capabilities, claim verification features, and Model Context Protocol (MCP) observability. The project appears designed to ru
A developer is seeking beta testers for 'Ollama Cloud Chat,' an Android application that integrates Ollama's cloud models with a mobile chat interface. The post likely discusses features, how to parti
For programming tasks with an RTX 5080 (16GB VRAM) and 64GB RAM, optimal quantized models include Qwen 3 14B at Q6 quantization, Llama 3.1 13B at Q8, or DeepSeek R1 Distill 14B Q4, all of which fit co
Trooper v2.1 is a tool that provides automatic fallback functionality from cloud-based LLM services to local Ollama instances when cloud quota limits are exceeded, incorporating context compaction to
Freely is a lightweight (~10 MB) desktop overlay application designed to enhance work and meetings by providing AI-powered features including system audio capture, screenshot functionality, and integr
This discussion thread covers how to adjust temperature parameters in Ollama, the local language model platform. The post likely addresses configuration methods for controlling model sampling temperat
A Reddit discussion in the r/ollama community seeking recommendations for RAG (Retrieval-Augmented Generation) models, likely addressing model selection for local LLM-based document retrieval systems.
A seasoned developer seeking advice on selecting an Apple product to locally host large language models in the 27-36 billion parameter range, discussing the trade-offs and specifications of different
This Reddit thread likely discusses hardware recommendations and considerations for purchasing a new laptop capable of running Ollama, a tool that enables running large language models locally. The di
A community repository of AI agent configurations for Ollama has reached 888 GitHub stars, featuring pre-built setups and configurations for running AI agents locally. The project appears to focus on
Quanty AI is a local AI companion playground built with Ollama as the backend, featuring animated pixel art graphics and interactive micro fiction experiences. The project integrates agent skills to e
Thoth, a local-first desktop AI assistant, now supports Model Context Protocol (MCP) tools, allowing users to run it fully locally with Ollama or integrate frontier APIs as needed. The application pri
The Ministral-3:3b model requires Ollama 0.13.1, which is in pre-release , and users encountering errors when running it face various issues including memory allocation problems and GPU/CPU offloading
A discussion about AI agents that can remember information from one interaction to the next, even across separate sessions , exploring how to implement persistent memory systems for personal AI assist
MiMo-V2.5-Pro is a fully open-sourced Mixture-of-Experts language model with 1.02T total parameters and 42B active parameters , available under the MIT License for commercial use, training, and fine-t
Cua Driver is an open-source macOS driver that allows any AI agent (Claude Code, Codex, or custom loops) to control applications in the background with built-in multi-cursor support. Agents can click,
DeepSeek V4 models on Ollama Cloud support three thinking modes: 'No thinking' for fast answers, 'Thinking' for careful analysis, and 'Max thinking' for maximum reasoning effort . Users can adjust thi
The NVIDIA Tesla K80 is a legacy GPU that can run modern LLMs through Ollama with community-maintained patches, since official Ollama dropped support for CUDA Compute Capability 3.7 hardware. Each K80
Xiaomi released and open-sourced MiMo-V2.5-Pro, delivering significant improvements over its predecessor in agentic capabilities, complex software engineering, and long-horizon tasks. The model is an
This post compares TensorRT-LLM and llama.cpp (GGUF) as inference frameworks for running coding agents like Cline and RooCode on RTX 5090 GPUs, examining the tradeoff between inference speed and VRAM
TuneForge is an MCP (Model Context Protocol) server that enables coding agents like Claude and Cursor to perform machine learning operations directly within chat interfaces, including dataset generati
A discussion evaluating the value proposition of a Beelink Mini S compact computer with Intel N95 processor and 8GB RAM at a €95-105 price point for running a budget 24/7 home server, likely including
Ollama Cloud has made DeepSeek-V4-Flash available , but the Reddit discussion likely addresses why the more powerful DeepSeek-V4-Pro—with 1.6T total parameters offering performance rivaling top closed
Based on the Reddit post title, this entry likely discusses common mistakes and pitfalls in setting up personal Retrieval-Augmented Generation (RAG) systems with Ollama, specifically focusing on incor
The Qwen 3.6-27B and 35B models are designed as open-weight models that developers can run locally on their own hardware without requiring cloud services. Alibaba released a separate cloud-only produc
The Reddit post discusses building a custom agentic environment in Go programming language, specifically designed to provide isolated sandbox environments for individual agents. This approach focuses
DeepSeek-V4-Pro is a Mixture-of-Experts language model with 1.6 trillion total parameters and 49 billion activated per token, supporting a 1 million token context length. Released under the MIT Licens
This Reddit post from r/ollama asks about story-writing language models that can run on a 5080 GPU with 16GB of VRAM . The discussion likely covers recommended open-source or quantized models suitable
A community catalog documenting practical use cases for Hermes Agent, a self-improving AI agent built by Nous Research that features automatic skill creation, cross-session memory, and 70+ built-in sk
A developer describes building a persistent-state AI system using Ollama with three models (a 4B router model, a 9B primary model, and a 9B 'subconscious' model) running on dual RTX 3060 GPUs, demonst
This Reddit post from r/ollama discusses concerns about Microsoft using developer code for Copilot model training and advocates for protection of personal code repositories. Users can opt out of havin
A Reddit post discussing performance issues with GLM-5.1 when running through Ollama Cloud. GLM-5.1 is Z.AI's next-generation flagship model for agentic engineering, with significantly stronger coding
By default, Ollama binds to port 11434 on localhost, which means it's accessible only on your own machine. Ollama has no built-in authentication and should be secured with firewall rules, VPN, or reve
This Reddit post from r/ollama asks the community about AI agent orchestration software for managing multiple Hermes agents, posted by a retired individual with available hardware resources. The post
The Reddit post 'Benchmarking programs?' in r/ollama likely discusses tools and methods for measuring the performance of local language models running on Ollama. Available benchmarking tools for Ollam
A free, open-source CLI coding agent that runs locally using Ollama and can read, write, and edit files while running shell commands through natural language. The tool supports Claude API as an altern
A developer created a command-line tool that integrates Graph RAG (Retrieval-Augmented Generation) with Obsidian, using Ollama to run a local LLM for extracting entity relationships from notes. The to
Ollama does not officially support TPUs or NPUs currently , though community discussions and projects are exploring integration possibilities. The Reddit post likely addresses user questions about whe
Whistant is an on-phone AI buddy that helps users get things done directly from their iPhone without requiring a Mac. It breaks requests into step-by-step subtasks and executes them on the device, inc
An MCP bridge project that enables integration between AI coding tools (Kiro, Claude, and Cursor) and local Ollama instances for offline model inference. The bridge facilitates communication between t
Kimi K2.6 is an open-source model featuring advanced coding, long-horizon execution, and agent swarm capabilities that is now available via Ollama Cloud . The model excels in coding and agentic tools
A user reported satisfaction with Gemma 4 Cloud but switched to GLM 5.1 due to API errors, noting that the alternative model consumes significantly more resources. The post likely discusses the perfor
An open-source debugging tool designed for AI pipelines that provides trace timeline visualization, differential analysis, node replay capabilities, and operates without telemetry, licensed under MIT.
This post discusses Graph RAG, an approach that uses local LLMs with Ollama to build graph-based knowledge indexes from source documents by deriving entity knowledge graphs and pregenerating community
This GitHub project (AG-X) implements deterministic safety checks for Ollama agents, designed to catch malformed JSON responses, detect prompt injection attempts, and handle model refusals before they
A discussion exploring the 'sweet spot' of using Ollama's hybrid Cloud + Local setup, where a reachable Ollama host serves as the control point for both local and cloud models . The post likely covers
Based on the Reddit post title, Arrow appears to be a tool for processing SAM (Supplier Agreement Management) contracts stored in CSV and SQLite formats, with optional integration of Ollama to generat
Models like Qwen3 and Llama 3.2 are commonly used for n8n RAG workflows , with selection depending on use case requirements. Running Ollama models locally requires at least 16 GB of RAM on your device
A guide on disabling thinking mode in Ollama models using the CLI by running models with the `--think=false` flag or using `/set nothink` followed by a prompt. The post likely discusses how to configu
This Reddit thread discusses running Ollama on a resource-constrained 8GB CPU-only ARM VPS, addressing common challenges such as out-of-memory errors and model response looping. For purely CPU-only se
Yes, Ollama models can be used with the Codex app on Windows. Ollama supports all major operating systems, including Windows , and open models can be used with OpenAI's Codex CLI through Ollama — Code
Google DeepMind released MedGemma, a collection of medical vision-language foundation models based on Gemma 3 in 4B and 27B parameter sizes, demonstrating advanced medical understanding and reasoning
A community member shared a project on r/ollama (posted in Spanish) announcing the creation of a custom FUSE (Filesystem in Userspace) implementation designed to work with Ollama, the popular local LL