Research
SoundWeaver: Compositional Warm-Starting for Text-to-Audio Diffusion Serving
arXiv:2603.07865v2 Announce Type: replace-cross Abstract: Text-to-audio (T2A) diffusion models generate high-quality audio but require tens of neural function evaluations (NFEs), resulting in substant
arXiv:2603.07865v2 Announce Type: replace-cross Abstract: Text-to-audio (T2A) diffusion models generate high-quality audio but require tens of neural function evaluations (NFEs), resulting in substantial inference latency. Existing acceleration methods primarily optimize each generation trajectory independently, even when reusable acoustic structure exists in prior examples. We introduce SoundWeaver, the first training-free framework for compositional cross example acoustic reuse. Rather than generating from pure noise, SoundWeaver constructs a prompt-conditioned acoustic prior from segments distributed across cached audios and warm-starts diffusion from an intermediate noise level. We introduce an Acoustic Composition Graph (ACG), which uses neural codec representations and segment-level identification to identify candidate cross-cache transitions and structured path search to jointly optimize prompt relevance and acoustic continuity. We further establish a warm-start error bound showing how prior quality and diffusion SNR jointly govern the admissible skip depth, motivating an adaptive contextual-bandit Skip Gater that selects the warm-start level for each request. Across T2A diffusion backbones, SoundWeaver achieves 1.48-3.74x generation speedup with only a 1K-clip cache while improving generation quality.
Related
- CAB: Accelerating Flow and Diffusion Sampling via Rectification and Corrected Adams-Bashforth
- Accelerating Diffusion Sampling via Exploiting Local Transition Coherence
- Spectrally-Guided Diffusion Noise Schedules
- Manifold-Constrained Noise Optimization for Diverse Diffusion Sampling
Source: arXiv cs.CV | 2026-10-06