Tools
30B -> 300T tokens per month YoY @togethercompute
Together AI achieved a 10,000x increase in monthly token throughput over one year, scaling from 30 billion to 300 trillion tokens per month. This milestone demonstrates significant growth in their API
Together AI achieved a 10,000x increase in monthly token throughput over one year, scaling from 30 billion to 300 trillion tokens per month. This milestone demonstrates significant growth in their API usage and infrastructure capacity for serving large language model inference at scale.
Related
- Training code and models are live on Hugging Face. Dan Fu (Together AI's VP of Kernels) led the work. Together AI provided compute. Blog: ht…
- EinsteinArena is open-source and the leaderboard is live. We welcome contributions and feedback! → https://www.together.ai/blog/einsteinaren…
- Try Kimi K2.6 now on the AI Native Cloud: http://www.together.ai/models/kimi-k26#
- Run it on the AI Native Cloud — serverless and dedicated infrastructure. https://www.together.ai/models/minimax-m2-7
- MiniMax M2.7 is now on Together AI. Trained by letting it run its own RL loop, resulting in the highest open-source score on MLE Bench Lite.
Source: Together AI (X) | 2026-04-23