Search: “models”

Disclosure: I’m the author and maintainer of QuarkStar. I built QuarkStar, a small native inference engine inspired by Antirez’s DwarfStar. QuarkStar currently supports: Qwen3.6-35B-A3B, using the sam

Each villager in Pepperton is a different model — a mistral, a qwen3, a qwen2.5, a phi4-mini, a llama3.2 — because model families have genuinely different temperaments, and the friction between them i

GPT-Live is so good that I use it almost every day. I've been wanting to replicate it since it was released. My first attempt was to fine-tune Gemma 4 12B to behave like a full-duplex model. Something

Hey y'all. I'll be concise. TL;DR: DS V4-Flash-0731 @ UD-IQ2_M running fully in VRAM on 3xMI50s (90.9 GB model, 96 GB VRAM). Actual speed on llama-server is: - Text Generation: ~15-16 tokens/second st

🚀 We just built our first real-time implementation of Graph Engineering, inspired by our experience building graph tooling used by 4,000+ developers. 🔗 Repo: https://github.com/CodeGraphContext/grapha

I know in in this community LLM's are generally used for coding but there are other usecases besides coding and those usecases should be tested too. I also know benchmarks can sometimes be benchmaxxed

A few weeks ago I posted about if it was worth using a V620 for Comfyui, and was told it likely wouldn't work, at least in Windows 11. And if it did, it would be far too slow and unusable. I decided t

LFM2.5-Encoder is a family of multilingual bidirectional encoders built on the LFM2 architecture, available in two sizes: LFM2.5-Encoder-230M — a lightweight encoder for tight latency and memory budge

Hi everyone! We’ve just released a major update to the leaderboard! We are expanding beyond Python with a new multilingual slice featuring real-world software engineering tasks across 5 languages. Ope

GigaChat Audio 10B is an audio-native LLM built on top of the GigaChat 3.1 Lightning text model. A Conformer speech encoder and a modality adapter feed audio embeddings directly into a Mixture-of-Expe

I understand that the laguna model is either still buggy or potentially benchmaxxed. So I’d like to know for people who really tested, are DS flash or Hy3 really better in your usecase? submitted by /

Just noticed this exists, 1M context MOE with 48B par seems just like what Ive been looking for - it runs pretty damn fast too compared to Qwen 3.6 35B. after some testing it seems capable of producin

One thing I noticed in American politics, whenever the government wants to push unpopular actions or laws, they often introduce fear to convince the public to support them. This is actually how i view

The primary driver of this project is that I'd become frustrated with the reasoning behavior of smaller local models such as Qwen3.6-27B (i believe particularly at lower temperatures, and where system

I managed to get this model working on 2x 3090s with full 262k ctx and N=4, if anyone is interested to try it, thanks to this quant: https://huggingface.co/danielrmay/NVIDIA-Nemotron-Labs-3-Puzzle-75B

I cannot provide a factual summary for a knowledge base without accessing the actual content. Reddit post titles often contain subjective language and don't reliably convey the full argument. To creat

Ideogram 4.0 is a frontier text-to-image foundation model released as an open-weight model with a commercial license. The model delivers frontier-grade text rendering across languages, bounding-box la

ComfyUI-Angelo now supports Qwen-Image-Edit, an advanced image editing model that provides text editing features and the ability to edit both semantics and appearance of images. The model applies Qwen

This error in ComfyUI occurs when the einops library encounters a broken TensorFlow installation while performing multi-backend type checks, even though ComfyUI itself is PyTorch-based. The primary so

HiDream-Studio v.01 was open-sourced on May 8, 2026, releasing the HiDream-O1-Image model (8B parameters) with both undistilled and distilled variants. HiDream-O1-Image is a unified image generative f

This post documents a 10-day project to build a local AI system using open-source tools and models, specifically combining Ollama (a local LLM framework), Gemma 4 (a language model), Claude Cowork 3P,

This post benchmarks three Qwen3.6 model variants against gpt-oss:120b when running on Apple Silicon hardware, evaluating their performance characteristics and practical usability. It documents both t

The Ministral-3:3b model requires Ollama 0.13.1, which is in pre-release , and users encountering errors when running it face various issues including memory allocation problems and GPU/CPU offloading

TuneForge is an MCP (Model Context Protocol) server that enables coding agents like Claude and Cursor to perform machine learning operations directly within chat interfaces, including dataset generati

WAI-ANIMA 1.0 is a newly released Stable Diffusion checkpoint model from the WAI model family, likely combining elements of the WAI-Illustrious anime generation lineage with the Anima diffusion archit

This r/ollama thread discusses using Ollama as a local model provider for OpenAI's Codex CLI, covering configuration and setup. Open models can be used with OpenAI's Codex CLI through Ollama, allowing

This Reddit thread discusses a user's experience attempting LoRA fine-tuning of the Gemma 4 26B-A4B model on a 16GB VRAM GPU, where training loss decreases normally but the resulting model degenerates

The Ostris AI Toolkit added immediate, day-zero support for training LoRA adapters on top of Baidu's ERNIE-Image model, continuing the toolkit's pattern of rapidly integrating newly released image gen

This Reddit post on r/ollama likely discusses the concept and usage of a 'Master AI Orchestrator' CLI tool — a command-line interface designed to coordinate and manage multiple AI agents or models, de

This Reddit post discusses how open-source AI models have advanced to rival GPT-4-level performance and can be run locally for free using Ollama — a tool that lets users download and manage large lang

This r/StableDiffusion post showcases a workflow for converting anime-style images into photorealistic outputs, directly comparing two AI image editing models: Klein 9B and Qwen Image Edit 2511. Qwen

This r/StableDiffusion thread addresses performance issues with the Qwen-Image-Edit-2511 FP8 mixed model in ComfyUI, where users experience slow image edit times of 30–40 seconds per step (or overall)

This r/ollama community post is a practitioner's guide sharing personal, real-world experience running Ollama on everyday consumer hardware in 2026, covering which models, quantization settings, and c

Users in the r/ollama community reported that Qwen3.5 models fail to install or load in Ollama, with common errors including 'Error: 500 Internal Server Error: unable to load model' even after a ...

When using Ollama Pro's cloud models with OpenClaw, a local Ollama installation is not strictly required — OpenClaw is an AI agent execution layer that handles tools, memory, scheduling, and messa...

**Paramax** (also referred to as 'Parax' in the Reddit post title) is a small Python library by Daniel Ward that provides parameterizations and parameter constraints for JAX PyTrees, designed to wo...

Warning: Kinda long post. If you don't like reading, please skip for your own sanity. Also, I've got nothing to sell, just a tinkerer, so I just want to share ideas and learn from you guys too. When I

Hello everyone! ​I like dumb things. I like working with weak computers and microcontrollers. I like the simplicity and low electricity usage. Simply put, the efficiency of a 'dumb' PC. ​The first tim

Spent two nights getting deepseek-ai/DeepSeek-V4-Flash-0731 (284B MoE, 13B active, native FP4/FP8, 1M context) running production-grade on two DGX Sparks connected by one QSFP DAC cable. Everything —

Heeeey all! I just completed some fun tests with Muse Glimmer, I thought I'd let you know. In fact, the summary below was written by Muse itself! I ran a 2× DGX Spark cluster and got Meta's day-old Mu

Avid claude code user here looking to do equivalent things with local models. Just want to plug in something like Qwen and have the interface be 1:1 with claude code. Any suggestion? submitted by /u/N

Demand for low-precision inference, including NVFP4-based approaches, has grown as large language models are increasingly deployed in latency and cost constrained production environments. Quantization

Tweet by u/hackerllama Could be copium, but I would love to see Gemma 4.1 there with unified audio input for all model sizes perhaps even up to 120B, much improved tool calling (even with the latest t

I have various quants of this model and am curious how they perform. can anyone recommend which benchmark would be a good test case for quantization effects? Maybe that can be completed with about 1 m

I’ve been using 3.6 27B Q4, and that quant is fast on an M5. The code has been average, but consistently “good enough.” And, after a year, I can see home LLMs being served at home much like streaming

I compared Qwen 35B-A3B MoE against Qwen 27B dense on a series of local coding-maintenance tasks. On my R9700/llama.cpp setup, the MoE model generated about 3.9× faster (~116 vs ~30 tok/s), but the co