Xiaomi just claimed 1,000+ tps on a 1T model using a standard 8-GPU server
Xiaomi achieved over 1,000 tokens per second output from a 1 trillion-parameter model using a single standard 8-GPU commodity node through extreme model-system codesign . The approach combines FP4 qua