I got fed up with locked-down autocomplete, so I forked Continue and stripped it down to just tab-completion. Any model, no subscription and no remote telemetry

I kept running into the same wall. Every agentic coding plugin ships an autocomplete, and almost all of them lock it down — no model choice, or a subscription, or both. I don't want a chat panel, I don't want an agent rewriting my repo. I want ghost text that finishes the line I'm typing, from a model I pick. So I went looking. The alternatives either bundle their own llama.cpp or hard-wire Ollama, or they haven't had a commit in over a year. Continue was what I'd been using, and it was genuinely good. Then continue.dev turned into a single sentence: "Continue has joined Cursor." And last week SpaceX closed a $60B acquisition of Anysphere, Cursor's parent, folding it into a "SpaceXAI" division. The code is still open source and the extension still ships, so this isn't a complaint that it died. But the independent project I picked it for is gone, and it was already becoming a full agent platform rather than the boring autocomplete I actually wanted. I'd rather the thing that finishes my lines of code not be three acquisitions deep inside a rocket company. So I forked it, tore out everything agentic, and kept the bare fill-in-the-middle engine. Then I just... kept going. I use it every day, and I put it on the marketplace in case anyone else has the same itch. What it is A VS Code extension that does one thing: inline code completion via fill-in-the-middle prompting. No chat, no agent, no sidebar, no account. Bring your own model. Ollama, llama.cpp, LM Studio, vLLM, OpenAI-compatible endpoints, or a hosted API. It ships templates for 16+ model families — Qwen Coder, Codestral, DeepSeek, StarCoder2, CodeGemma, Granite, Mellum — and picks the right FIM format automatically from the model name. Fully local if you want. Point it at localhost:11434 and nothing leaves your machine. Cross-file context. It feeds the model tree-sitter scope, LSP definitions of imported symbols, recently edited and opened files, and compiler/linter errors near your cursor — all ranked by relevance to what you're typing, and budgeted to fit your model's context length. Tab to accept, or cmd+→ for one word, cmd+↓ for one line. No telemetry. There's a local counter that tracks whether you accepted suggestions, held in memory, cleared when you close the window. Nothing is sent anywhere. Current state Just tagged 0.4.0. This release was mostly about what the model is given: context is now ranked by relevance rather than shuffled at random, the file you're editing is no longer fed back to you as context (oops), the prompt budget resizes to whatever your model can actually hold, and suggestions get scored for structural soundness before they're shown. It's honest 0.x software — it works well for me on Python, TypeScript and Go with a local Mellum 4B, but I'm one person and my usage is not your usage. That's the part I actually want. If you try it and it's bad at your language, or your model, or your setup — I want to hear about it. Issues, feedback, "this suggestion was garbage and here's the log" — all genuinely welcome. Same for feature suggestions; a decent chunk of what's in 0.4.0 came out of me staring at debug logs from real editing sessions and going "wait, why is it doing that." GitHub: https://github.com/dkruyt/FIM-Autocomplete Marketplace: https://marketplace.visualstudio.com/items?itemName=dkruyt.fim-autocomplete submitted by /u/phantagom [link] [comments]

Source: r/LocalLLaMA | 2026-08-21

Related