Search: “models”

I have question. I am trying to train a LORA, and my concept is for Indian wedding and tradional wardrobe based on Regions. I was planning to train a model which understand each region clothing style

If you were able to get an inference machine that could do decode at 1k toks/s or even 10k tok/s, would that even be helpful? Would it unlock any new use cases? Let’s assume that this is for actually

Hey y'all! How is it going. Today this will be a short posting for posterity, mostly so the future llm/scraping overlords catch it since they like reddit and also for anyone out there trying this shit

Following some recent commits in llama.cpp, preserve_thinking behavior for chat templates included in older DSV4 ggufs got broken. This makes the model pretty dumb in a coding agent context. Adding kw

Someone in the comments of my 27B post-train bakeoff asked for the 35B version, so I ran it. Same setup as last time: fresh Coder workspaces on my k8s cluster, each driving my own agent (Hermes) headl

tldr; we are going to host K3 on A100s (yes, thats correct, we'll try to see if it holds up), H200s & B300s - expect results for A100s & H200s this week while we setup the B300 cluster this weekend &

Some Ling-3.0-flash threads here last week ended on the same two questions with no real answer, so I went through the repos. State as of writing, with links so you can check instead of taking my word

Qwen3.6-27B: SFT vs continued pre-training vs RL? I’m interested in adapting Qwen3.6-27B, but I’m increasingly unsure whether conventional SFT/LoRA is the best route if the goal is to add a capability

Hi everyone, I have a system which I have been using for gaming, R7 5700X, 48GB DDR4, RTX3090 24GB. But I want to use it for Local AI to reduce my reliance on cloud AI providers (mainly usage limits -

Hello, I've been learning how to use local LLMs for a year or so on my workstation, using a RTX3090. Current setup : - i5 12400 - 64gb RAM - RTX 3090 - OS : Fedora KDE workstation I'm using LMStudio t

This is an open source and free tax engine which scored 96% on TaxCalcBench [highest ever recorded score till date] surpassing fable 5 and sol with just sonnet 5. The only 2 cases where it missed, it

I've been building a C99 inference engine from scratch (no Python, no BLAS, just gcc and make) that runs BitNet's ternary models on CPU. A few weeks ago I got obsessed with the matmul kernel - wrote a

If you're running Laguna S 2.1 on llama.cpp and hitting thinking loops because it won't close its </think> tags, you might want to look at your quant before you spend too much time tweaking settings.

LLMs handle speech well once you run speech-to-text. They don't hear the rest: a bird outside, a glass breaking two rooms away, a smoke alarm two floors down. I've been working on an experimental open

Frontier models are just so good though. Fable 5... Gemini 3.1 Pro for design critique and brainstorming. Grok for verification passes. Antigravity with Gemini 3.5 Flash for rote plan execution. Openc

Google added an empty thinking token to the Gemma 4 chat template, which stabilizes model output by suppressing 'ghost' thought channels that may appear even when thinking is deactivated. This update

Pipeline parallelism in llama.cpp distributes model layers across multiple GPUs, with each GPU holding a contiguous slice of layers . However, the Reddit post likely discusses inefficiencies in how pi

Krea 2, Krea's first foundation image model built from scratch, was announced on May 12, 2026 , with a focus on aesthetics, style transfer, and creative control . Krea 2 became available to everyone s

Gemma 4 12B is the first medium-sized, encoder-free multimodal model capable of natively ingesting audio and video , recently released by Google. The model is available on Ollama with 11.7M downloads

MiMo-V2.5-Pro is a model available on Hugging Face that was requested to be added to Ollama's cloud models in May 2026. The discussion on r/ollama likely covers the availability status of this Xiaomi-

Nanocoder 1.27.0 is an agentic coding tool available in your terminal that runs on any AI model you choose, whether local models via Ollama or cloud providers like OpenAI and Anthropic. This release i

This post discusses creating or using a LoRA (Low-Rank Adaptation) model compatible with Flux Klein 9b, an AI image generation model, specifically for generating comic book-style characters. The discu

Google introduced Gemini 3.5, its latest family of models combining frontier intelligence with action capabilities, representing a major leap forward in building more capable, intelligent agents. The

Anima is a 2 billion parameter text-to-image model focused on anime concepts, characters, and styles, with capability for non-photorealistic content. Preview versions are intermediate model checkpoint

DeepSeek-v4 Flash through Ollama is currently available as a cloud model, where Ollama's CLI sends API calls to Ollama's hosted version rather than running locally . Local support for DeepSeek V4 Flas

ForgePilot is a desktop workspace application designed for Ollama that combines local language model capabilities with development tools, including support for Model Context Protocol (MCP), web resear

An iOS application that enables large language models to run directly on-device using llama.cpp technology, allowing users to integrate their own Ollama instances for processing Apple HealthKit data t

LTX-2.3 is an open-source video generation model capable of producing slow-motion effects and hyper-detailed visuals , with 4K output up to 20 seconds and native audio . The model addresses creator pa

This Reddit post documents a user's experiment asking ChatGPT and Gemini about their subjective experience of being an AI, exploring how these language models respond to philosophical questions about

MiMo-V2.5 is Xiaomi's multimodal AI model with native visual and audio understanding that supports up to 1 million tokens of context. The GGUF format refers to quantized versions of the model optimize

DeepSeek V4 models on Ollama Cloud support three thinking modes: 'No thinking' for fast answers, 'Thinking' for careful analysis, and 'Max thinking' for maximum reasoning effort . Users can adjust thi

This Reddit discussion post addresses a beginner's question about choosing between 3B and 7B parameter models for fine-tuning on multi-task reasoning problems. The post likely contains advice from exp

Rumors suggest OpenAI may release GPT-5.5 on April 23, 2026 , following accidental leaks of the model in OpenAI's Codex platform that showed GPT-5.5 alongside other unreleased models . Internally code

Flux 2-Klein-9B NVFP4 is a quantized image generation model that runs on mid-range GPUs like the RTX 3050. On this hardware, the model produces 1024-resolution images but with relatively slow inferenc

A discussion exploring the 'sweet spot' of using Ollama's hybrid Cloud + Local setup, where a reachable Ollama host serves as the control point for both local and cloud models . The post likely covers

This r/StableDiffusion post showcases a community-created LoRA model built for the Flux image generation architecture, designed to replicate the distinctive artistic style of Gustav Klimt (1862–1918),

A Reddit post on r/MachineLearning sharing an open-source project and accompanying book by Sebastian Raschka that walks through implementing GPT-2, Llama 3, and DeepSeek from scratch using PyTorch, wi

A Reddit user shared a community-made patch to enable proper FP16 support for the Ernie Image model in ComfyUI, targeting NVIDIA 20-series (Turing) GPUs. 20-series cards do not support bfloat16 , and

A community researcher shared on r/MachineLearning how they extended Chatterbox TTS — Resemble AI's open-source, 500M-parameter model — to support 8 Indian languages using LoRA (Low-Rank Adaptation),

Tencent HY-World 2.0 is an open-source AI world model that generates real 3D scenes directly usable in game engines like Unreal Engine and Unity; unlike previous versions which produced video-based wo

A Reddit user on r/StableDiffusion built a locally-running RAG (Retrieval-Augmented Generation) engine designed to eliminate the need for manually crafting lengthy, model-specific image generation pro

This Reddit thread on r/ollama discusses whether the NVIDIA DGX Spark — powered by the GB10 Grace Blackwell Superchip and delivering 1 petaFLOP of performance — is a worthwhile investment for running

A Reddit post in the r/ollama community seeking volunteers with diverse hardware setups to participate in a collaborative effort to benchmark the **behavioral reliability** of locally-run large langua

This Reddit thread from r/ollama discusses user perspectives on **Ollama Pro** as a paid/upgraded tier compared to cloud-based AI coding assistants like Anthropic's Claude and OpenAI's Codex, likely f

Users building agentic pipelines with Hermes models in Ollama report an issue where the model correctly generates tool call JSON in its response but the actual tool functions are never invoked or exec

This r/StableDiffusion post covers community-created style LoRA adapters trained on the visual art style of *Slay The Spire 2*, built for use with Black Forest Labs' FLUX.2 Klein 9B model — a 9-billio