Local Ai
Running 32B–70B Ollama models when your own GPU is too small: looking for beta testers
Hey everyone! I'm the founder of ComputeNexa, a small GPU cloud for people who want bigger models than their own hardware can run, but still privately. - Pick a GPU (24–80 GB) and the Private Chat app
Hey everyone! I'm the founder of ComputeNexa, a small GPU cloud for people who want bigger models than their own hardware can run, but still privately. - Pick a GPU (24–80 GB) and the Private Chat app: you get your own Ollama + Open WebUI, opened in the browser, with no SSH or setup. - Want an API instead? The Model API app serves the model through vLLM with an OpenAI-compatible endpoint. - US or Canada region. The GPU is yours alone while it runs. It's a small closed beta. Approved testers get $5 of free credit (a few hours on a 24 GB GPU). I’d love honest feedback from the community. What works, what doesn’t, and what would make this useful for you? Sign up: https://computenexa.com/early-access/ Happy to answer anything here. submitted by /u/Broad_Breakfast_1172 [link] [comments]
Related
Source: r/ollama | 2026-10-19