DiffVC-ONE: Diffusion-based Generative Video Compression with One-Step Video Diffusion Transformer

arXiv:2608.20515v1 Announce Type: new Abstract: Generative video compression can recover rich visual details at low bitrates, but simultaneously achieving high temporal consistency and low inference cost remains challenging. To address this issue, we propose DiffVC-ONE, a diffusion-based generative video compression framework built on a one-step Video Diffusion Transformer. First, we introduce a Unified Unidirectional Latent Compressor that uses a shared model to efficiently and uniformly compress compact latent slices. We then develop a Video DiT-based One-Step Diffusion Enhancer that uses the reconstructed latent slices as content anchors and performs single-step spatio-temporal perceptual enhancement over an entire group of pictures. Finally, a Hybrid Condition Generator extracts structural, strength, and semantic conditions from the reconstructed content and quantization information. These conditions preserve faithful regions, control the degree of generative enhancement, and supplement content-aware perceptual details during one-step diffusion enhancement. Extensive experiments on multiple standard benchmarks demonstrate that DiffVC-ONE achieves state-of-the-art perceptual quality and temporal consistency with low inference cost.

Related

• Compression as Adaptation: Implicit Visual Representation with Diffusion Foundation Models
• Generative Video Compression Based on Hierarchical Referencing
• Active Sampling for Ultra-Low-Bit-Rate Video Compression via Conditional Controlled Diffusion
• Group-of-Latents: Perceptual Video Compression at Extreme Bitrates via Masked Latent Generative Modeling
• FrameDiT: Diffusion Transformer with Matrix Attention for Efficient Video Generation

Source: arXiv cs.CV | 2026-08-24