Local Ai
I built a tiny site that let's you feel the tokens/s before you buy the GPU
I made a tiny site that let's you feel how fast a local LLM runs before buying the hardware. I made it for myself and a friend but thought it could be useful for others. Note that it works as an estim
I made a tiny site that let's you feel how fast a local LLM runs before buying the hardware. I made it for myself and a friend but thought it could be useful for others. Note that it works as an estimate and not perfectly as it will vary per user setup. repo: https://github.com/nicorobinreal/llmspeed submitted by /u/nypaavsalt [link] [comments]
Related
- Getting a feel for how fast X tokens/second really is.
- Would you consider 5t/s usable for a local model?
- Built this yesterday with Qwen3.8-Flash-Next (NVFP4, 262K context) on a single NVIDIA DGX Spark
Source: r/LocalLLaMA | 2026-10-17