Search: “models”

Wowee!! Just when you thought it couldn't get better for open weight models, we probably have had our best period yet!?!?! Models that rival the closed frontier, Opus level models on non-insane hardwa

There's an interactive chart and some extra data in the blog post if you're interested. There are plenty of KL-divergence benchmarks for GGUF models, but most of them compare one GGUF quant against an

Summary from https://www.reddit.com/r/StableDiffusion/comments/1vh9rtw/ama_minimax_h3_team_ask_us_anything_about_our/ This summary was compiled with AI but cross-checked manually by me for accuracy. I

I’m planning a dedicated home AI server, mainly for local LLM inference, agents/tool use, Docker services, and eventually larger MoE models with CPU offload. My plan is to start with 2x 16GB GPUs = 32

Not the biggest or shiniest, but it's mine From gaming machine inference on the original llama models, to a 4x RTX 6000 Pro Max Q + 4x 3090s local AI cluster. Pictures are in reverse chronological ord

Hey everyone! Scenema Audio is now a native ComfyUI custom node. Same model that powers scenema.ai now quantized so it fits on 8GB VRAM. When we first released it a few months ago as an API and Docker

The video is one real run, not a mock-up: grapharc go 'why did checkout latency spike at 09:14 UTC?' --model ollama/qwen3:8b A local 8B model proposes the graph → triage fanning out into four parallel

# Running DeepSeek-V4-Flash-0731 (155 GB MoE) on a DGX Spark with vLLM-Moet 2-bit quantization I used Deepseek-v4-Flash-0731 cloud API settig up vllm-moet to run deepseek-v4-flash with MTP locally on

Built my 1st inference machine and have been tweaking models trying to get the most out of my modest hardware. I think I’m at a good place but I’m testing with my own prompts. I’ve looked into some of

I'm currently using the gemma4:31b-cloud, and it is pretty good, but sometimes it gets confused. Are there more free tier models out there I should try out? or is gemma4 the cap of free tier cloud mod

Hello all - i just got a new mac mini with 24GB of RAM and wanting to run local AI for Home Assistant and Hermes. I have been struggling to find a snapy model that will work with my machine. Currently

So you’ve got a 3090 or maybe even a 5090? Or more likely a 4060 8GB Ti. You wanna try local AI, you don’t know what it can/can’t do. 1) Install the best model you can. If you have a 3090 or a 5090, t

Is Qwen 3.6 27b still the go' ol' reliable at this point? I know 35b is faster but it just doesn't give as good results. Is it possible to run deepseek v4 flash on a single spark at decent tk/s withou

I have been running some experiments with smaller open-weight LLMs on multiple-choice questions of Swedish medical licensing exams. On a dataset called MedQA-SWE, GPT-4 scored 84% accuracy in 2024 and

audio.cpp again :) Release 0.4 is out. The headline this time is new high-quality TTS coverage plus GGUF becoming a first-class across the project. What’s new: Added Higgs Audio v3 TTS 4B, Fish Audio

I am building a domain-specific AI agent powered by Ollama (using the qwen:2.5 model). For data retrieval, the agent utilizes multiple search APIs: DuckDuckGo Search (DDGS), Tavily, Serper, and Google

AI9Stars has released G9v3-3B an open weights language model designed to deliver strong reasoning capabilities within a lightweight 3 billion parameter size. It is released under the Apache 2.0 licens

LLaDA2.2-flash is an agent-oriented diffusion language model in the LLaDA2 series. By introducing Levenshtein Editing (with DELETE and INSERT control tokens) to diffusion language modeling, it represe

Below Upstream Status sections are from https://github.com/PrismML-Eng/Bonsai-demo Upstream Status for Binary Q1_0 is supported out of the box in upstream llama.cpp across many backends: CPU (generic,

Introduction RxBrain (Hy-Embodied-RxBrain-1.0) is a unified multimodal foundation model for embodied cognition — a single model that couples language reasoning with visual imagination to deliver three

A developer created a fully local, CPU-based voice interface for Ollama that enables hands-free conversation with AI models by combining three open-source components: Silero VAD (voice activity detect

This Reddit discussion explores user preferences and behaviors around AI model usage, examining whether people maintain subscriptions to multiple AI services or consolidate to a single primary platfor

Gemini 3.1 Pro and Gemini 3-Pro lead visual reasoning benchmarks , with GPT-5.2, Kimi-K2.5, and GPT-5.2-Pro following . A 2026 evaluation benchmarked 15 leading multimodal models on visual reasoning a

ComfyUI_HYWorld2 is a ComfyUI node implementation for HY-World 2.0, a multi-modal world model framework that generates 3D worlds from text, images, and videos by producing 3D world representations rat

This Reddit post from r/StableDiffusion seeks community guidance on replicating a specific art style using Stable Diffusion, covering recommended models, LoRA (Low-Rank Adaptation) fine-tuning techniq

A developer created an open-source GUI application with a brutalist design for interacting with Ollama models and the Personal Iris (PI) platform. The application is compatible with both ARM64 and Int

Anima is a 2 billion parameter text-to-image model focused mainly on anime concepts and styles, but also capable of generating other non-photorealistic content. A Regional Condition Custom Node for An

An OpenAI general-purpose reasoning model autonomously disproved a conjecture posed by Paul Erdos in 1946, overturning 80 years of mathematical belief. The breakthrough concerns the planar unit distan

Agentmw is an open-source middleware framework designed to enhance AI agent reliability and efficiency across different models and frameworks. It addresses key operational challenges including mid-run

The search results focus on OpenCode + Ollama integration but don't specifically cover the AgentRouter tool. Let me provide a knowledge base entry based on what the title and context suggest: A tool d

This Reddit post likely compares inference performance metrics across popular language models running on Ollama, measuring tokens per second as a key performance indicator. The post would help users a

A Reddit user in r/StableDiffusion shared their experience training a Vision Transformer (ViT) model from scratch to automatically tag images, likely for use with image generation or classification ta

An open-source locally-run conversational AI that moves beyond simple request-response models by implementing persistent memory, belief, and self-reflection. The system stores all user profiles, memor

For programming tasks with an RTX 5080 (16GB VRAM) and 64GB RAM, optimal quantized models include Qwen 3 14B at Q6 quantization, Llama 3.1 13B at Q8, or DeepSeek R1 Distill 14B Q4, all of which fit co

Tuna-2 is a unified multimodal model that performs visual understanding and generation directly based on pixel embeddings, employing simple patch embedding layers to encode visual input without a VAE

This Reddit post from r/StableDiffusion asks the community for recommendations on which prompt engineering techniques and AI image generation models (specifically comparing z-image and z-image turbo v

By default, Ollama binds to port 11434 on localhost, which means it's accessible only on your own machine. Ollama has no built-in authentication and should be secured with firewall rules, VPN, or reve

Atelier is a canvas-like system that leverages generative image and video models to blend spaces for thinking and creation, where both references and generated assets co-exist in one unified workspace

This Reddit thread from r/ChatGPT discusses whether locally-run open-source AI models can match the capabilities of frontier models like ChatGPT. Leading open-source models like Llama 3.3 70B and Deep

This r/ollama community thread discusses practical strategies for managing context windows when using locally-run LLMs (via Ollama) for coding assistance on large codebases, where context limitations

This r/ChatGPT thread addresses user-reported issues with ChatGPT's 'Thinking' mode not functioning as expected, a common frustration among subscribers. Users have noted problems such as the thinking

A Reddit post from r/ChatGPT humorously describes a user's experience of ChatGPT's voice model abruptly ending a conversation in response to 'your mom' jokes, with the user then comically lamenting be

This r/ollama community thread discusses methods that users employ to inject personal context — such as notes, documents, and preferences — into locally-run AI models via Ollama. Common approaches exp

A community practitioner post on r/MachineLearning documenting an experiment fine-tuning Alibaba's Qwen2.5-0.5B-Instruct model in bf16 precision on a Reddit post summarization task using GRPO (Group R

A Reddit post on r/ollama showcasing a community-built, feature-rich macOS AI client designed for both local and cloud model access, including support for Ollama. The application emphasizes a modern,

This r/StableDiffusion thread discusses community recommendations for the highest-quality image generation models available. Flux 2 is widely regarded as arguably the best overall image generation mod