Local Ai
I got tired of ad-filled mobile wrappers for Ollama, so I built PocketLLM Lite an open-source, offline Android client (Local GGUF, SKILL.md plugins, local RAG)
Hey, Like a lot of people here, I use local models via Ollama on my desktop/server and wanted a mobile client that actually felt responsive, worked offline, and respected privacy. Most apps on the Pla
Hey, Like a lot of people here, I use local models via Ollama on my desktop/server and wanted a mobile client that actually felt responsive, worked offline, and respected privacy. Most apps on the Play Store are either subscription traps, loaded with ads, or route everything through third-party cloud servers. So I built PocketLLM Lite a 100% open-source, ad-free Flutter client designed specifically for local LLMs, GGUF models, and self-hosted Ollama workflows. ### 🛠️ Key Features: * Runs Offline & Connects to Ollama : Run GGUF models directly on-device or stream seamlessly from your home Ollama instance over Wi-Fi/Tailscale. * Thinking Accordion : Native streaming support for <think> reasoning blocks rendered in a collapsible Material 3 accordion UI. * Agentic Tool Calling Pipeline : Executes local math, system diagnostics, and knowledge lookup directly on the device with structured <tool_call> UI cards. * **Open-Standard Agent Skills (SKILL.md)** : Install skills directly from GitHub URLs or create custom skills offline with /autocomplete support. * **Web Search Fallback (Tavily Integration)** : Toggle live web search when offline models need current data, with inline markdown source citationsSource`. * Local Vector RAG : Ingest PDFs and text files locally to chat with your documents offline without sending data to external servers. * Offline STT & TTS : Voice-type your prompts offline and listen to completions using native speech engines. * Zero Ads & Zero Telemetry : Completely free, open-source (MIT License), and built with Material 3 Expressive UI. ### 📊 Performance Profiler: Built-in speed profiler to measure Time to First Token (TTFT) and token generation speed (tokens/sec) directly on your device hardware. * GitHub Repository : https://github.com/PocketLLM/pocketllm-lite * Release APK Downloads : https://github.com/PocketLLM/pocketllm-lite/releases I'd love to get feedback from the community on features or model interfaces you'd like to see next! submitted by /u/subaru_kun33 [link] [comments]
Source: r/ollama | 2026-08-03