Search: “r-ollama”

The NVIDIA Tesla K80 is a legacy GPU that can run modern LLMs through Ollama with community-maintained patches, since official Ollama dropped support for CUDA Compute Capability 3.7 hardware. Each K80

Xiaomi released and open-sourced MiMo-V2.5-Pro, delivering significant improvements over its predecessor in agentic capabilities, complex software engineering, and long-horizon tasks. The model is an

This post compares TensorRT-LLM and llama.cpp (GGUF) as inference frameworks for running coding agents like Cline and RooCode on RTX 5090 GPUs, examining the tradeoff between inference speed and VRAM

TuneForge is an MCP (Model Context Protocol) server that enables coding agents like Claude and Cursor to perform machine learning operations directly within chat interfaces, including dataset generati

A discussion evaluating the value proposition of a Beelink Mini S compact computer with Intel N95 processor and 8GB RAM at a €95-105 price point for running a budget 24/7 home server, likely including

Ollama Cloud has made DeepSeek-V4-Flash available , but the Reddit discussion likely addresses why the more powerful DeepSeek-V4-Pro—with 1.6T total parameters offering performance rivaling top closed

Based on the Reddit post title, this entry likely discusses common mistakes and pitfalls in setting up personal Retrieval-Augmented Generation (RAG) systems with Ollama, specifically focusing on incor

The Qwen 3.6-27B and 35B models are designed as open-weight models that developers can run locally on their own hardware without requiring cloud services. Alibaba released a separate cloud-only produc

The Reddit post discusses building a custom agentic environment in Go programming language, specifically designed to provide isolated sandbox environments for individual agents. This approach focuses

DeepSeek-V4-Pro is a Mixture-of-Experts language model with 1.6 trillion total parameters and 49 billion activated per token, supporting a 1 million token context length. Released under the MIT Licens

This Reddit post from r/ollama asks about story-writing language models that can run on a 5080 GPU with 16GB of VRAM . The discussion likely covers recommended open-source or quantized models suitable

A community catalog documenting practical use cases for Hermes Agent, a self-improving AI agent built by Nous Research that features automatic skill creation, cross-session memory, and 70+ built-in sk

A developer describes building a persistent-state AI system using Ollama with three models (a 4B router model, a 9B primary model, and a 9B 'subconscious' model) running on dual RTX 3060 GPUs, demonst

This Reddit post from r/ollama discusses concerns about Microsoft using developer code for Copilot model training and advocates for protection of personal code repositories. Users can opt out of havin

A Reddit post discussing performance issues with GLM-5.1 when running through Ollama Cloud. GLM-5.1 is Z.AI's next-generation flagship model for agentic engineering, with significantly stronger coding

By default, Ollama binds to port 11434 on localhost, which means it's accessible only on your own machine. Ollama has no built-in authentication and should be secured with firewall rules, VPN, or reve

This Reddit post from r/ollama asks the community about AI agent orchestration software for managing multiple Hermes agents, posted by a retired individual with available hardware resources. The post

The Reddit post 'Benchmarking programs?' in r/ollama likely discusses tools and methods for measuring the performance of local language models running on Ollama. Available benchmarking tools for Ollam

A free, open-source CLI coding agent that runs locally using Ollama and can read, write, and edit files while running shell commands through natural language. The tool supports Claude API as an altern

A developer created a command-line tool that integrates Graph RAG (Retrieval-Augmented Generation) with Obsidian, using Ollama to run a local LLM for extracting entity relationships from notes. The to

Ollama does not officially support TPUs or NPUs currently , though community discussions and projects are exploring integration possibilities. The Reddit post likely addresses user questions about whe

Whistant is an on-phone AI buddy that helps users get things done directly from their iPhone without requiring a Mac. It breaks requests into step-by-step subtasks and executes them on the device, inc

An MCP bridge project that enables integration between AI coding tools (Kiro, Claude, and Cursor) and local Ollama instances for offline model inference. The bridge facilitates communication between t

Kimi K2.6 is an open-source model featuring advanced coding, long-horizon execution, and agent swarm capabilities that is now available via Ollama Cloud . The model excels in coding and agentic tools

A user reported satisfaction with Gemma 4 Cloud but switched to GLM 5.1 due to API errors, noting that the alternative model consumes significantly more resources. The post likely discusses the perfor

An open-source debugging tool designed for AI pipelines that provides trace timeline visualization, differential analysis, node replay capabilities, and operates without telemetry, licensed under MIT.

This post discusses Graph RAG, an approach that uses local LLMs with Ollama to build graph-based knowledge indexes from source documents by deriving entity knowledge graphs and pregenerating community

This GitHub project (AG-X) implements deterministic safety checks for Ollama agents, designed to catch malformed JSON responses, detect prompt injection attempts, and handle model refusals before they

A discussion exploring the 'sweet spot' of using Ollama's hybrid Cloud + Local setup, where a reachable Ollama host serves as the control point for both local and cloud models . The post likely covers

Based on the Reddit post title, Arrow appears to be a tool for processing SAM (Supplier Agreement Management) contracts stored in CSV and SQLite formats, with optional integration of Ollama to generat

Models like Qwen3 and Llama 3.2 are commonly used for n8n RAG workflows , with selection depending on use case requirements. Running Ollama models locally requires at least 16 GB of RAM on your device

A guide on disabling thinking mode in Ollama models using the CLI by running models with the `--think=false` flag or using `/set nothink` followed by a prompt. The post likely discusses how to configu

This Reddit thread discusses running Ollama on a resource-constrained 8GB CPU-only ARM VPS, addressing common challenges such as out-of-memory errors and model response looping. For purely CPU-only se

Yes, Ollama models can be used with the Codex app on Windows. Ollama supports all major operating systems, including Windows , and open models can be used with OpenAI's Codex CLI through Ollama — Code

Google DeepMind released MedGemma, a collection of medical vision-language foundation models based on Gemma 3 in 4B and 27B parameter sizes, demonstrating advanced medical understanding and reasoning

A community member shared a project on r/ollama (posted in Spanish) announcing the creation of a custom FUSE (Filesystem in Userspace) implementation designed to work with Ollama, the popular local LL

A Reddit post in r/ollama showcasing a newly built LLM-powered penetration testing tool, likely leveraging Ollama to run open-source language models locally for security testing workflows. The tool is

**mcpstrike** is a tool shared on the r/ollama subreddit that integrates a locally-run LLM (via Ollama) with an MCP (Model Context Protocol) server to autonomously execute penetration testing workflow

A Reddit thread from the r/ollama community where a user seeks assistance with the initial setup and configuration of Ollama, a tool for running large language models locally. The discussion likely co

Qwen 3.6 Plus Preview is Alibaba's next-generation large language model released on March 30-31, 2026 , and the first open-weight variant was released following the February Qwen 3.5 series, prioritiz

A Reddit post from the r/ollama community titled 'Two AIs walk into a bar...' likely showcases a humorous or experimental multi-agent conversation in which two locally-run AI models (via Ollama) inter

This Reddit thread discusses the compatibility issues users face when attempting to run Ollama on macOS Big Sur (11.x), as recent versions of Ollama have shifted their minimum requirements — the curre

A Reddit post from r/ollama documenting a locally-run, privacy-preserving multi-agent coding system called 'agent-forge,' built around three specialized roles — Architect (planning), Executor (code ge

AetherMind is a locally-run personal memory system built by a Reddit user (r/ollama) that leverages Ollama with the `qwen2.5:7b` model and Retrieval-Augmented Generation (RAG) to allow users to query

RoleCraft is an open-source, privacy-focused resume tailoring application that runs AI models locally using Ollama, allowing users to customize their resumes to match specific job descriptions without

This Reddit post from r/ollama discusses a user's experience running Cline (an AI coding agent) with Ollama on a high-end local hardware setup consisting of an NVIDIA RTX 4090 with 24GB VRAM and an In