Model Releases
deepseek posted way more alpha on their zhihu page, if you only read twitter you are reading the laowai approved stuff 'Based on this framew…
deepseek posted way more alpha on their zhihu page, if you only read twitter you are reading the laowai approved stuff 'Based on this framework, we have implemented a high-throughput, low-latency larg
deepseek posted way more alpha on their zhihu page, if you only read twitter you are reading the laowai approved stuff "Based on this framework, we have implemented a high-throughput, low-latency large-scale inference service for DeepSeek V4.1 Flash. Currently, the service throughput of a single cluster is 155 trillion tokens/day, and the overall revenue is 38 per card per hour (based on off-peak prices)." it costs roughtly 5-10 per gpu hour so depseek is claiming 80% serving margin at THEIR prices lololololol 🚀 Introducing DeepInfer, our in-house inference framework, now fully open source! Powering DeepSeek-V4.1-Flash at scale with high throughput and low latency. We’re sharing our production stack to help the community lower compute costs, reduce energy use, and make AI more afforda…
Related
- 🚀 Introducing DeepInfer, our in-house inference framework, now fully open source! Powering DeepSeek-V4.1-Flash at scale with high throughpu…
- IMO DeepSeek v4 demonstrated utter confidence and competence by not benchmaxxing, not focusing on some BS final run cost, not even spending …
- damn deepseek moves fast on roon tweets
Source: Swyx (X) | 2026-10-20