Model Releases
llm performance community metric
my question about LLM performance We see a lot of posts about token prediction, token generation per second, etc. But is it really the metric? I can see that DeepSeek V4 Flash 0731 (with DSPark; mac s
my question about LLM performance We see a lot of posts about token prediction, token generation per second, etc. But is it really the metric? I can see that DeepSeek V4 Flash 0731 (with DSPark; mac studio + llama.cpp) produces about 22–28 TPS, but I also see that the LLM does a lot of reasoning. And this relates to others. So maybe the correct way is not to check TPS or other metrics, but to check execution: task complexity/second. I don't know if such a metric already exists and if it exists why community doesn't use it by default submitted by /u/AleksandrNikitin [link] [comments]
Related
- What speeds are everyone getting with deepseek v4 flash 0731?
- DeepSeek V4 Flash 0731 IQ2_M benchmark for Dual 3060 and 96GB RAM ≈ 3.5 tok/s.
- Ran DS V4-Flash-0731 Locally on 3xMI50 32GB @ ~15 t/s TG
- I updated my localy run benchmark with DeepSeek V4 Flash 0731
Source: r/LocalLLaMA | 2026-09-13