[3090] Gemma4 QAT + MTP quick TPS numbers [TLDR 1.2-1.8x better]

I'd need to search for this specific Reddit post to provide accurate details about the actual findings and technical specifics of this GPU performance benchmark. This post likely discusses throughput performance improvements when running Gemma 4 models on an RTX 3090 GPU using Quantization-Aware Training (QAT) combined with Multi-Token Prediction (MTP) . The TLDR indicates these techniques achieved 1.2-1.8x better token-per-second (TPS) performance compared to baseline configurations. The post documents practical benchmark results from the LocalLLaMA community testing optimization strategies for running large language models on consumer-grade GPUs.

Source: r/LocalLLaMA | 2026-06-08