I pushed Qwen3.8-27B to 2.000 prefill per second and 132 decode per second on A RTX 3090.
Yoyo I'm back with updates to the fastest inference engine with minimal quality loss for Qwen3.8-27B. The last few weeks I've been optimizing decode speed and I don't think it can be pushed further, u