Training Lora with 2x 5060 Ti

Another question asked 1 thousand time, but I can't find actual threads. Sorry in case of mistake. Due to interstellar price of hardware like high-end GPU (more than 5k euros for a 5090 and similar price for an A6000) is not possible for me to build a system with 32GB or 48GB VRAM on single GPU. Only GPU like 5060 Ti mantain a decent price even if rised in last months. In march I've buyed a new MSI 5060 Ti Inspire 2X (less than €600) over a Z890 platform with 64GB RAM DDR5. Now can I buy another MSI 5060 Ti Shadow 2X (less than €750) to build multi-gpu Blackwell system. It's ok for inference: generating photo or video or upscaling with ComfyUI is not a problem due to a vast node ecosystem developed by community. I ask a LLM like Gemini or Claude to help me a build that system, but they says that a multi-gpu for training or fine-tuning is possible but not recommended in primary way due to slow bandwidth compared with HE GPU. But time generation for me is not a problem because during day I spent just a cent thanks to my FV system. Until today I ever use Ostris AI Toolkit via GUI, that not support multi-gpu generation. IA wrote me that Ostris use PyTorch FSDP with accelerate if used through CLI. Diffusion-pipe use instead Pipeline Parallelism to abrupt VRAM consumption and made possible training video-lora with LTX2.5 or MiniMax H3 on consumer GPU. Either system used on Windows 11 OS with WSL2 + Debian. Can you confirm this scenario and can you confirm that if I spent for a new 5060 Ti I can build a system for training video-lora with my system without OOM? Please don't suggest me to use runpod or vast.ai service: I use it sometimes, but in some cases the policy for generating x-rated content are strict. submitted by /u/Inner_Employment_332 [link] [comments]

Source: r/StableDiffusion | 2026-09-17