Search: “hardware”

Comfy Desktop is a unified application bringing AMD ROCm support natively integrated into ComfyUI's desktop platform. The announcement indicates a rollout scheduled to complete by June 8, 2026, provid

This post documents running the Qwen3.6-35B-A3B language model on dual GTX 1080 Ti GPUs using Ollama, achieving approximately 20 tokens per second. The author highlights three critical configuration r

This post documents a creative project combining multiple AI image and video generation tools—SDXL, DMD-2, SEEDVR2, and LTX-2.3—with video editing software Shotcut to create a multi-day production. Th

A user reports successfully running Qwen 3.6 35b MoE (mixture of experts) with Zoo Code on an M1 Max Mac, achieving local inference without external servers. The setup enables fully local, battery-pow

Ollama exposes an Anthropic-compatible Messages endpoint , allowing developers to run powerful open-source AI models locally with no API costs and pair them with Claude Code for a capable local AI cod

This Reddit post discusses a technical setup for running Ollama with three NVIDIA RTX 3060 GPUs (each with 12GB VRAM) on a Machinist motherboard paired with a Xeon processor and 32GB of system RAM. Th

This post describes a custom Stable Diffusion graphical interface optimized for older graphics cards, specifically the GTX 1060, incorporating features like zero-copy ADetailer (a detail enhancement t

A discussion from the r/ollama community about using local large language models for privacy-sensitive applications, particularly for handling sensitive documents like medical records. Local LLMs proc

This guide provides instructions for setting up local AI capabilities on a 2019 Mac Pro running Ubuntu 24.04, covering the installation and configuration of ROCm 7.2.3 GPU drivers, PyTorch 2.10 for ma

Comfyui-Mesh now supports LTX 2.3 with the ability to distribute models across multiple GPUs or networked machines using Nvenc codec for video generation. The update includes significant VRAM optimiza

This guide demonstrates that modern AI image generation models beyond Stable Diffusion 1.5 can run on a GTX 1060 6GB GPU using optimization techniques and ComfyUI, countering the common misconception

This Reddit post likely compares inference performance metrics across popular language models running on Ollama, measuring tokens per second as a key performance indicator. The post would help users a

LTX-2.3 INT8 benchmarks discuss INT8 quantization optimized for Ampere GPUs (RTX 30XX series), which offers a balance between speed, VRAM usage, and quality. These INT8 models are designed to speed up

Bare Metal: Z-Image Turbo - Flux.2 Klein 9b - Wan 2.2 discusses comparisons between these lightweight AI image generation models, with Flux.2 Klein 9B showing good prompt adherence and natural composi

This post provides a detailed review and practical guide for setting up and testing Ollama with DeepSeek models specifically on Ryzen APU systems. It likely covers performance benchmarks, configuratio

A Reddit post from r/StableDiffusion where a user expresses amazement at the realism of AI-generated images, specifically noting they achieved impressive results using Z-image-Turbo on a consumer-grad

Ollama on mobile phones enables developers and enthusiasts to build privacy-first apps that process data locally and create offline AI tools for tasks like summarization, translation, and chatbots, re

This discussion examines the practical performance gains of quantization techniques when deployed in production environments, particularly addressing whether theoretical speedups translate to real-wor

This post discusses upgrade recommendations for improving local LLM inference performance on a gaming laptop with an RTX 4080 (12GB VRAM) and 16GB system RAM. Community members likely shared options f

This Reddit post discusses the viability of using second-hand custom-built RTX 2080 Ti GPUs with 22GB VRAM for running Stable Diffusion models in ComfyUI, including whether two cards could be linked v

This discussion thread explores lightweight vision-language models that can run locally, including options like Llama 3.2 Vision, Qwen2.5-VL, and SmolVLM2, optimized for tasks like OCR and visual ques

A seasoned developer seeking advice on selecting an Apple product to locally host large language models in the 27-36 billion parameter range, discussing the trade-offs and specifications of different

MiMo-V2.5 is Xiaomi's multimodal AI model with native visual and audio understanding that supports up to 1 million tokens of context. The GGUF format refers to quantized versions of the model optimize

Qwen3.6 27B is a 27-billion parameter language model that can achieve approximately 60 tokens per second throughput when running on dual RTX 5060 Ti GPUs with 16GB memory each, using the vLLM inferenc

I need to check the actual content of this post to provide an accurate summary. FLUX.2 [klein] 9B is a 9 billion parameter image generation model capable of generating images from text descriptions an

A discussion evaluating the value proposition of a Beelink Mini S compact computer with Intel N95 processor and 8GB RAM at a €95-105 price point for running a budget 24/7 home server, likely including

This Reddit post from r/ollama asks about story-writing language models that can run on a 5080 GPU with 16GB of VRAM . The discussion likely covers recommended open-source or quantized models suitable

A community catalog documenting practical use cases for Hermes Agent, a self-improving AI agent built by Nous Research that features automatic skill creation, cross-session memory, and 70+ built-in sk

LTX released an HDR IC-LoRA beta that enables precise control over video generation by transferring structure and motion from reference videos, supporting features like EXR output for professional wor

LTX-2 is a professional-grade video generation model built for long-form, high-fidelity output with precise creative control. This diffusion transformer model generates high-fidelity video and synchro

INT3 compression with fused Metal kernels enables large language models to compute attention operations directly on compressed (INT3/INT4) key-value cache representations using custom GPU kernels that

The Reddit post 'Benchmarking programs?' in r/ollama likely discusses tools and methods for measuring the performance of local language models running on Ollama. Available benchmarking tools for Ollam

Users training LTX-2.3 LoRAs on RTX 4090s typically use the official ltx-trainer tool, though the model officially targets H100 GPUs with lower VRAM setups requiring gradient checkpointing and reduced

EditAnything IC-LoRA is a unified control adapter trained on LTX-2.3-22b that enables multiple control signals for video generation, allowing fine-grained video-to-video control on top of text-to-vide

A guide on disabling thinking mode in Ollama models using the CLI by running models with the `--think=false` flag or using `/set nothink` followed by a prompt. The post likely discusses how to configu

This Reddit thread discusses running Ollama on a resource-constrained 8GB CPU-only ARM VPS, addressing common challenges such as out-of-memory errors and model response looping. For purely CPU-only se

This r/StableDiffusion post is a community-driven benchmark comparing multiple quantization formats — fp8, nvfp4, fp16, and INT8 — of Baidu's ERNIE Image Turbo text-to-image model, using a standardize

A Reddit thread from the r/ollama community where a user seeks assistance with the initial setup and configuration of Ollama, a tool for running large language models locally. The discussion likely co

A Reddit post on r/StableDiffusion showcasing a locally generated 12-second AI video clip styled after Hot Wheels toy car racing, produced using LTX-Video — a low-memory, open-source video generation

A Reddit user shared a community-made patch to enable proper FP16 support for the Ernie Image model in ComfyUI, targeting NVIDIA 20-series (Turing) GPUs. 20-series cards do not support bfloat16 , and

This Reddit thread from r/ChatGPT discusses whether locally-run open-source AI models can match the capabilities of frontier models like ChatGPT. Leading open-source models like Llama 3.3 70B and Deep

This Reddit thread on r/ollama discusses how to find and set up AI-powered autocomplete extensions for VS Code that work with locally running Ollama models. A popular solution involves a local AI codi

A r/StableDiffusion thread where a user seeks a Google Colab notebook cell that replicates the img2img generation style or workflow of tools like 'grok' or 'neno-banana' — likely referring to specific

A community-shared open source CLI agent project posted to r/ollama, designed specifically for use with 8K token context windows in local Ollama-based LLM setups. Version 0.3 focuses on improving Olla

This r/StableDiffusion thread seeks community recommendations on AI image generation tools, reflecting a common discussion in the subreddit where users compare options like Stable Diffusion (run local

This r/ollama community guide provides a practical breakdown of which AI language models (and combinations of models) can realistically fit within the unified memory constraints of common Apple Silico