Model Releases
DeepSeek-V4-Flash-Vision-Exp (285B MoE) on 10-12x RTX 3090 — spec decoding, vision
Running the full deepseek-ai/DeepSeek-V4-Flash-Vision-Exp on consumer Ampere — 10-12x RTX 3090, SM86-compatible vLLM build. 285B MoE, FP4 experts + FP8 attention, 157 GB weights. Highlights: - **60+ t
Running the full deepseek-ai/DeepSeek-V4-Flash-Vision-Exp on consumer Ampere — 10-12x RTX 3090, SM86-compatible vLLM build. 285B MoE, FP4 experts + FP8 attention, 157 GB weights. Highlights: - 60+ tok/s decode, DSpark spec (k=3) on 10 GPUs (TP2xPP5), at a 240 W cap - 120+ tok/s on 12 GPUs (TP4xPP3) - Vision + spec + tool calls all working - 1M context (no offload) / 4M (RAM offload) - ~3,500 tok/s long-context prefill Fully documented + reproducible: - Pre-built image: docker pull ghcr.io/ciprianveg/3090-vllm:dsv4-flash-vision-sm86 - Repo: https://github.com/ciprianveg/3090-vllm (build guide, start scripts, runtime patches) The patches cover the DSpark propose-gate (spec + vision fix), scheduler mm x spec row-crossing, grammar-bitmask validation, vision ViT OOM fix, FlashInfer workspace-lane keying, and more. submitted by /u/ciprianveg [link] [comments]
Related
- Testing Deepseek-V4-Flash-Vision-EXP on Dual RTX6000 build
- I asked DeepSeek-V4-Flash to work with Muse-Glimmer for Vision ability in PI agent and it produced this
- DeepSeek-V4-Flash-Vision-Exp is amazing at creating game worlds!
Source: r/LocalLLaMA | 2026-09-09