SVDQuant + native INT8/W4A4 for Krea 2 on ComfyUI — up to 2x faster, works on any modern NVIDIA GPU

Quantized Krea 2 Turbo checkpoints for ComfyUI, up to 2x faster and about a third smaller than the usual FP8 version — no calibration dataset, no quality cliff. How to use it (short version): clone the repo into custom_nodes/, download one checkpoint into models/diffusion_models/, grab the text encoder + VAE Krea 2 already needs, load the example workflow. Full steps in the README, it's like 4 steps. Links: - Weights + benchmarks + example images: https://huggingface.co/AlperKTS/Krea-2-SVDQuant-ComfyUI - Code (custom nodes + the quantization script, if you want to build your own): https://github.com/alperktt/Krea-2-SVDQuant-ComfyUI Why it's faster: most "quantize Krea 2" advice online is FP8. That only helps if your GPU has FP8 tensor cores (Ada/Hopper/Blackwell). On anything older (RTX 20/30-series) FP8 gets cast back to bf16 and doesn't speed anything up I measured it, FP8 was slower than plain bf16 in my tests. INT8 and W4A4 tensor cores go back much further (Turing, RTX 20-series+), so those are the formats I actually targeted. Benchmarks (RTX 3090, 1024x1024, 8 steps): checkpoint size first run (cold) warm run vs. BF16 BF16 (unquantized reference) 24.48 GB 25.3 s 21.3 s 1.0x FP8 e4m3, scaled (emulated on Ampere) 12.24 GB 22.2 s 19.2 s 1.1x INT8 tensorwise + convrot (not in this upload) 13.16 GB 13.3 s 10.4 s 2.0x W4A4 + convrot, no low-rank branch 7.50 GB 10.3 s 10.1 s 2.1x W4A4 + SVDQuant low-rank, rank 16/64/128 7.6-8.3 GB ~19.3 s 10.1-10.2 s 2.1x Also fixed a bug along the way: the standard ComfyUI LoRA loader silently applies LoRAs to only ~12% of the layers on quantized models like this (no error, it just doesn't patch most of the network). The included loader fixes that. Tested with a hard prompt (small multi-line text) and an easy one (big text + two people, weird angle) example images for every variant are in the HF repo if you want to see the actual quality tradeoff before downloading anything. Community project, not affiliated with Krea — license details in the repo. Happy to help if something doesn't load right. submitted by /u/LightAppropriate624 [link] [comments]

Source: r/StableDiffusion | 2026-07-25

Related