Knowledge catalogue
Let me try to explain this clearly, simply, and neatly. Originally, I just wanted to build a small WebUI adapter with an admin panel, but things escalated over the last few months. At first, I faced t
I've been considering Ollama's Cloud Max plan to replace my GLM Max plan but couldn't find good documentation on how their limits actually translate into GLM 5.2 usage. I know it's by GPU time but tha
This release introduces native Computer Use for Windows and macOS, allowing Row-Bot to interact with desktop applications while keeping the user firmly in control. Computer Use is opt-in and protected
I am currently running Qwen3.6-30B in Ollama, through Cline to use as an agent in VSCode. Qwen's skill in coding is not in question, but the performance in VSCode is slow and inaccurate and times out
I have a 48GB M5 Pro and have far too many development projects going that just don't need the power of Anthropic to churn through so have started looking into running local models and while it certai
A developer created a local codebase memory system for agentic integrated development environments (IDEs) using Ollama and ChromaDB, enabling AI-assisted coding without reliance on cloud services. The
OpenCodeRAG is a local embedding service using FastAPI and SentenceTransformer, paired with a Node.js plugin that integrates RAG tools with Qdrant vector database via YAML configuration. It provides a
This post discusses a solution for keeping multi-hop retrieval-augmented generation (RAG) systems updated when data changes, using an embed-and-append approach with the open-weights Llama-3.3-70B mode
A developer created a fully local, CPU-based voice interface for Ollama that enables hands-free conversation with AI models by combining three open-source components: Silero VAD (voice activity detect
This post discusses running Google's Gemma 4 QAT (Quantized Aware Training) 12B model on a GPU with 8GB of memory while maintaining a 16k token context window. The author likely shares performance ben
Row-Bot is a local-first desktop AI assistant that orchestrates tools and models to handle reasoning and workflows while keeping data local. The demo likely showcases how Row-Bot's integrated tools, k
Users can delete chat instances in Ollama's GUI by right-clicking and deleting each chat individually, though there is a feature request for a 'Select All' option to delete multiple chats at once. Alt
A developer expanded on Andrej Karpathy's LLM Council concept by implementing an enhanced system with Docker containerization, Model Context Protocol (MCP) integration, skill modules, web search capab
MTP (Multi-Token Prediction) doubled generation speed but provided only ~3% total latency reduction at 64k context length on an RTX 3090 GPU. The limited overall benefit at large context sizes suggest
Nanocoder is an open coding agent for the terminal built by a community collective rather than a company. It allows users to bring their own model, keep code on their machine, and owe nothing to anyon
This post discusses troubleshooting steps for connecting Visual Studio Code running on Windows to an Ollama instance installed on a local Ubuntu server, addressing configuration and connectivity issue
Row-Bot is a local-first desktop AI assistant that can check emails and integrate multiple tools in a single conversation turn . The application includes integrated tools, a personal knowledge graph,
A developer created a Windows GUI tool for managing and benchmarking different llama.cpp builds, addressing the needs of AMD GPU users who work with multiple compute backends like Vulkan, ROCm, and HI
A user announced a major update to their Ollama coding assistant featuring Cline, an autonomous coding agent that operates within IDEs and can create, edit files, execute commands, and interact with t
Ollama automatically unloads inactive models from memory based on inactivity parameters, with models being removed after a specified duration of non-use . By default, Ollama unloads a model after 5 mi
User seeks guidance on PDF processing methods for local AI agents built with Ollama, comparing approaches like PDFPlumber extraction, vector database RAG systems, and alternative techniques for accura
This post seeks guidance on configuring local AI infrastructure on an AMD-based Linux system (7900 XTX GPU with CachyOS), specifically covering the setup of large language models via Ollama, AI agents
A developer created a minimal IDE for Ollama that automatically detects hardware capabilities and provides a streamlined user interface without unnecessary complexity. The tool aims to simplify the us
A developer documented their experience building a fully-local paper Retrieval-Augmented Generation (RAG) system using two NVIDIA GTX 1080 Ti GPUs and one RTX 3090, sharing three significant challenge
A tiny Windows system tray tool that monitors local Ollama runtime with quick visual feedback about status, resource usage, and models . The app uses color-coded tray icons for quick status checks and
The Mac mini M4 uses unified memory architecture where CPU and GPU share a single 24GB memory pool, while the RTX 5060 has dedicated VRAM. Mac mini M4 is preferred for large model inference (70B param
A discussion on building an AI-powered article generator using CrewAI and Ollama with specialized AI agents for research and writing to generate comprehensive articles on any topic. The solution runs
I don't have the ability to access or retrieve the content of specific Reddit posts from URLs. To write an accurate summary for your knowledge base, I would need you to either: 1. Share the text conte
A discussion on r/ollama exploring which high-performance LLM models can be effectively run locally on standard laptop hardware , likely covering model size comparisons, hardware requirements, and per
Gemma 4 12B is the first medium-sized, encoder-free multimodal model capable of natively ingesting audio and video , recently released by Google. The model is available on Ollama with 11.7M downloads
MiMo-V2.5-Pro is a model available on Hugging Face that was requested to be added to Ollama's cloud models in May 2026. The discussion on r/ollama likely covers the availability status of this Xiaomi-
Nanocoder 1.27.0 is an agentic coding tool available in your terminal that runs on any AI model you choose, whether local models via Ollama or cloud providers like OpenAI and Anthropic. This release i
This post documents running the Qwen3.6-35B-A3B language model on dual GTX 1080 Ti GPUs using Ollama, achieving approximately 20 tokens per second. The author highlights three critical configuration r
This Reddit discussion from r/ollama explores user experiences with uncensored Ollama language models, featuring anecdotal accounts of unusual or extreme use cases and recommendations for popular unce
Adds knowledge to Ollama models using Retrieval-Augmented Generation (RAG) , where users create a knowledge base directory with reference files like PDFs, text files, or CSVs . A custom model can be c
A Reddit post discussing an issue where Ollama (an AI model tool) refuses to process or list a C# game script due to safety concerns about potential destructive code. The post likely explores the limi
Ollama Cloud enables running large language models without a powerful GPU by offloading them to Ollama's cloud service . However, recent reports document significant reliability issues, including freq
MiniMax M3 launched on June 1, 2026 as the first open-weights model to combine frontier coding, a 1-million-token context window, and native multimodality. The model achieves top-tier performance on c
A developer created an open-source GUI application with a brutalist design for interacting with Ollama models and the Personal Iris (PI) platform. The application is compatible with both ARM64 and Int
Liquid AI released LFM2.5-8B-A1B, a device-optimized model designed to power real-life applications on phones, laptops, PCs, robots, and lightweight server-side use-cases. The model is a fast, memory-
An open-source browser with built-in AI agents that emphasizes privacy and automation, enabling task automation through natural language without coding. The browser supports multiple AI providers incl
An updated MarkItDown API Server integrates Microsoft MarkItDown for converting PDF files, images, and Word documents to Markdown, with Ollama and LLaVA for generating image descriptions. This project
Web Chat para Ollama is a tool that enables users to run a private, free AI chat interface locally on their own machines using Ollama, an open-source framework for running large language models. The p
A Chrome extension built for automated web interaction and data extraction that uses Ollama's local LLM capabilities to intelligently navigate websites, scroll pages, fill out forms, type text, and sc
Ollama exposes an Anthropic-compatible Messages endpoint , allowing developers to run powerful open-source AI models locally with no API costs and pair them with Claude Code for a capable local AI cod
Mistral-7B v0.3 model achieves significant memory optimization when running at 128K context length in llama.cpp, reducing live VRAM usage from 22,657 MiB to 13,235 MiB while maintaining minimal perfor
Ollama Talk is an Android app that connects to an Ollama server, enabling conversations with AI models like Llama and Mistral . The app features an intuitive chat interface with real-time conversation
A developer created a local Model Context Protocol (MCP) memory server that integrates Ollama to provide AI coding assistants with persistent memory capabilities while maintaining complete privacy and
This discussion likely addresses concerns about whether Ollama has quietly reduced its cloud usage limits, as the platform has revised limits twice since launch. Ollama Cloud usage is governed by sess
This Reddit post discusses a technical setup for running Ollama with three NVIDIA RTX 3060 GPUs (each with 12GB VRAM) on a Machinist motherboard paired with a Xeon processor and 32GB of system RAM. Th
OpenStudio is a hybrid AI router that combines local model inference with cloud-based model access through OpenRouter, a unified API providing access to hundreds of AI models through a single endpoint
The raw reasoning stream can be accessed through the message.thinking field in the API response or the thinking endpoint field, which contains the reasoning trace separately from the final answer. Use
This project demonstrates a local AI system built with llama.cpp and Gemma 4 that captures and analyzes screen activity to create persistent memory of user computer interactions, enabling search, chat
A discussion about difficulties getting Ollama to fully utilize dual NVIDIA RTX 3090 GPUs when running various language models including 8B and 70B parameter models. Users report that despite Ollama r
Ollama can be installed on Mac by downloading the application and placing it in the Applications folder, after which you use Terminal to run commands that download and launch models . The best model c
Ollama has added MLX support for Qwen3.5 and Gemma 4 , with both MLX and NVFP4 quantization variants available for these models. There have been issues with broken Qwen3.6 NVFP4 generation on Ollama ,
This post describes a user's experience building a local AI agent using Ollama, an open-source tool for running large language models locally. The article likely covers the practical implementation st
This post describes setting up OpenClaw with a self-hosted Qwen 3.6:35b language model backend running on an H100 GPU for approximately $1.60 per hour, eliminating API rate limits. The user shares the
This project implements a local desktop application using Qwen2.5-VL (a vision-language model) and Ollama that enables users to interactively query visual content on their screen through a live overla
A discussion from the r/ollama community about using local large language models for privacy-sensitive applications, particularly for handling sensitive documents like medical records. Local LLMs proc