Search: “r-ollama”

Ollama on mobile phones enables developers and enthusiasts to build privacy-first apps that process data locally and create offline AI tools for tasks like summarization, translation, and chatbots, re

Pi Studio is an extension for Pi that opens a local two-pane browser workspace for working with prompts, responses, Markdown & LaTeX documents, code files, and other common file types. It includes a l

Thoth v3.21.0 is a local-first AI assistant with integrated tools including a personal knowledge graph, voice, vision, shell, and browser automation capabilities. This release introduces Buddy Compani

This post discusses upgrade recommendations for improving local LLM inference performance on a gaming laptop with an RTX 4080 (12GB VRAM) and 16GB system RAM. Community members likely shared options f

Claude Desktop has a third-party inference feature that lets you replace Anthropic's API with any model provider, including a local AI model running entirely on your machine. This feature can be activ

Ollama not using GPU is commonly diagnosed by running `ollama ps`—if it shows 100% CPU, Ollama isn't detecting the GPU. The issue typically has multiple causes, with common ones including driver probl

Parllama is a TUI (Text UI) application designed for easy management and use of Ollama-based LLMs that also works with major cloud-provided LLMs. It provides core model management features including f

A Reddit discussion from the Ollama community addresses reports of slow model responses, clarifying that the models themselves are not inherently slower but that rate limiting is a more likely cause o

claudely is a tool that enables users to run Claude Code against local LLM providers such as LM Studio, Ollama, or llama.cpp while preserving their existing Claude configuration. The tool allows devel

DeepSeek V3 and R1 API free tier includes 500M tokens per month , indicating free access remains available for API users. The search results focus on a major service outage in March 2026 and the recen

This post documents a 10-day project to build a local AI system using open-source tools and models, specifically combining Ollama (a local LLM framework), Gemma 4 (a language model), Claude Cowork 3P,

Hermes Agent provides a migration tool that imports OpenClaw setups into Hermes. The tool migrates your persona, memory, skills, configs, and API keys in a single command. The guide covers what gets m

Sentinel is a local-first AI coding desktop application built with Rust and Tauri that automatically routes coding tasks to appropriate models based on task complexity. Instead of swapping between mul

An open-source locally-run conversational AI that moves beyond simple request-response models by implementing persistent memory, belief, and self-reflection. The system stores all user profiles, memor

This post benchmarks three Qwen3.6 model variants against gpt-oss:120b when running on Apple Silicon hardware, evaluating their performance characteristics and practical usability. It documents both t

Ollama Cloud launched in September 2025 with fixed-price subscription tiers (20/month Pro, 100/month Max) for cloud-hosted inference , while local deployment remains free with unlimited local usage .

Ollama's MLX engine runs on NVIDIA GPUs via CUDA v13 on Windows and Linux. Users have reported that Ollama crashes on RTX 3060 with cuda_v13 in versions 0.13.0 through 0.15.6, while deleting the cuda_

Aura is a local-first AI daemon that enhances tools with persistent memory capabilities, claim verification features, and Model Context Protocol (MCP) observability. The project appears designed to ru

A developer is seeking beta testers for 'Ollama Cloud Chat,' an Android application that integrates Ollama's cloud models with a mobile chat interface. The post likely discusses features, how to parti

For programming tasks with an RTX 5080 (16GB VRAM) and 64GB RAM, optimal quantized models include Qwen 3 14B at Q6 quantization, Llama 3.1 13B at Q8, or DeepSeek R1 Distill 14B Q4, all of which fit co

Trooper v2.1 is a tool that provides automatic fallback functionality from cloud-based LLM services to local Ollama instances when cloud quota limits are exceeded, incorporating context compaction to

Freely is a lightweight (~10 MB) desktop overlay application designed to enhance work and meetings by providing AI-powered features including system audio capture, screenshot functionality, and integr

This discussion thread covers how to adjust temperature parameters in Ollama, the local language model platform. The post likely addresses configuration methods for controlling model sampling temperat

A Reddit discussion in the r/ollama community seeking recommendations for RAG (Retrieval-Augmented Generation) models, likely addressing model selection for local LLM-based document retrieval systems.

A seasoned developer seeking advice on selecting an Apple product to locally host large language models in the 27-36 billion parameter range, discussing the trade-offs and specifications of different

This Reddit thread likely discusses hardware recommendations and considerations for purchasing a new laptop capable of running Ollama, a tool that enables running large language models locally. The di

A community repository of AI agent configurations for Ollama has reached 888 GitHub stars, featuring pre-built setups and configurations for running AI agents locally. The project appears to focus on

Quanty AI is a local AI companion playground built with Ollama as the backend, featuring animated pixel art graphics and interactive micro fiction experiences. The project integrates agent skills to e

Thoth, a local-first desktop AI assistant, now supports Model Context Protocol (MCP) tools, allowing users to run it fully locally with Ollama or integrate frontier APIs as needed. The application pri

The Ministral-3:3b model requires Ollama 0.13.1, which is in pre-release , and users encountering errors when running it face various issues including memory allocation problems and GPU/CPU offloading

A discussion about AI agents that can remember information from one interaction to the next, even across separate sessions , exploring how to implement persistent memory systems for personal AI assist

MiMo-V2.5-Pro is a fully open-sourced Mixture-of-Experts language model with 1.02T total parameters and 42B active parameters , available under the MIT License for commercial use, training, and fine-t

Cua Driver is an open-source macOS driver that allows any AI agent (Claude Code, Codex, or custom loops) to control applications in the background with built-in multi-cursor support. Agents can click,

DeepSeek V4 models on Ollama Cloud support three thinking modes: 'No thinking' for fast answers, 'Thinking' for careful analysis, and 'Max thinking' for maximum reasoning effort . Users can adjust thi

The NVIDIA Tesla K80 is a legacy GPU that can run modern LLMs through Ollama with community-maintained patches, since official Ollama dropped support for CUDA Compute Capability 3.7 hardware. Each K80

Xiaomi released and open-sourced MiMo-V2.5-Pro, delivering significant improvements over its predecessor in agentic capabilities, complex software engineering, and long-horizon tasks. The model is an

This post compares TensorRT-LLM and llama.cpp (GGUF) as inference frameworks for running coding agents like Cline and RooCode on RTX 5090 GPUs, examining the tradeoff between inference speed and VRAM

TuneForge is an MCP (Model Context Protocol) server that enables coding agents like Claude and Cursor to perform machine learning operations directly within chat interfaces, including dataset generati

A discussion evaluating the value proposition of a Beelink Mini S compact computer with Intel N95 processor and 8GB RAM at a €95-105 price point for running a budget 24/7 home server, likely including

Ollama Cloud has made DeepSeek-V4-Flash available , but the Reddit discussion likely addresses why the more powerful DeepSeek-V4-Pro—with 1.6T total parameters offering performance rivaling top closed

Based on the Reddit post title, this entry likely discusses common mistakes and pitfalls in setting up personal Retrieval-Augmented Generation (RAG) systems with Ollama, specifically focusing on incor

The Qwen 3.6-27B and 35B models are designed as open-weight models that developers can run locally on their own hardware without requiring cloud services. Alibaba released a separate cloud-only produc

The Reddit post discusses building a custom agentic environment in Go programming language, specifically designed to provide isolated sandbox environments for individual agents. This approach focuses

DeepSeek-V4-Pro is a Mixture-of-Experts language model with 1.6 trillion total parameters and 49 billion activated per token, supporting a 1 million token context length. Released under the MIT Licens

This Reddit post from r/ollama asks about story-writing language models that can run on a 5080 GPU with 16GB of VRAM . The discussion likely covers recommended open-source or quantized models suitable

A community catalog documenting practical use cases for Hermes Agent, a self-improving AI agent built by Nous Research that features automatic skill creation, cross-session memory, and 70+ built-in sk