Model Releases
I built an open-source RAG chatbot starter that runs fully locally with Ollama (FastAPI + ChromaDB)
I kept re-wiring the same RAG plumbing on every project, so I turned it into a clean starter and open-sourced it. Upload a PDF, ask questions, and get answers with page-level source citations. It runs
I kept re-wiring the same RAG plumbing on every project, so I turned it into a clean starter and open-sourced it. Upload a PDF, ask questions, and get answers with page-level source citations. It runs with zero API keys — either in retrieval-only mode, or fully local with Ollama, so nothing leaves your machine. You can also plug in OpenAI, Claude, or Gemini with one env var. Stack: FastAPI + ChromaDB + SentenceTransformers, all in Docker. One docker compose up and it's running. Repo (MIT): https://github.com/panutpl/rag-chatbot-template-starter Happy to answer questions. Curious what everyone's using for chunking + retrieval these days — still tuning mine. submitted by /u/Calm-Cockroach1701 [link] [comments]
Related
- I built an Ollama (or Claude Code)-powered AI player that actually plays the game — open source, runs on local LLMs
- How I built a free, local AI powerhouse in 10 days (Ollama + Gemma 4 + Claude Cowork 3P + Browserless)
Source: r/ollama | 2026-07-23