Search: “models”

Most graph-based LLM interfaces use a canvas as a visual layer over what is still a linear chat. I wanted the graph itself to determine what Ollama receives. ThoughtDAG has one rule: wires are the con

I'm a software engineer who mainly builds softwaes/applications, and I'm starting to work on machine learning projects. Since ML workloads often require GPUs, I know services like Google Colab and Kag

Hey r/LocalLLaMA — maintainer here, obviously biased. OpenSmith is an open-source Python tracing tool for LLM pipelines. The idea: drop u/trace on any function, run opensmith ui, get a full local dash

I am setting up codex+ollama+qwen3.6:27b for my hobby coding project on a windows pc with rtx5090 - earlier i tried to setup vllm in Ubuntu container but couldn’t get that to work - now using ollama,

Hi everyone! Over the past five months I've been working on DKV (DifferentialKV), an open-source project exploring KV-cache compression for long-context local LLM inference. The goal is to reduce KV-c

like 8 months ago I was tinkering with both and gemini was so much better i went with that. I had a project at work that I needed an AI to sift through a manual and schematic for and no matter what, g

Hey everyone, I’m posting this question in the subreddit because I haven’t been able to figure it out with the help of AI. I’ve asked ChatGPT and Gemini, but their answers are all over the place. So,

In a previous post (https://www.reddit.com/r/LocalLLaMA/comments/1utefpr/running_qwen3_30b_a3b_at_50_toks_on_rtx_5060_ti/) there seemed to be great demand for bringing in Qwen3.5 35B. Some Gated Delta

I've been chasing the question of what algorithms a transformer can actually express -- separate from what it can learn. So I built a compiler: define a computation graph in ordinary Python, and it pr

Even if China was distilling from US models (assuming all accusations are true), nothing about it makes it illegal. It is like saying you distilled knowledge from your professor in colleges and now he

At the moment MLX (and Llama.cpp for Macs) run 16bit activations everywhere. Despite this, the M5 generation silicon actually does support INT8 activations - it actually allows w4a8 d_type. It's just

Having read some merged PRs in the past, I know that they were fully written by Claude Code (or similar), so this basically fixes the delusion. But at the same time, we might start seeing more AI slop

I kept re-wiring the same RAG plumbing on every project, so I turned it into a clean starter and open-sourced it. Upload a PDF, ask questions, and get answers with page-level source citations. It runs

I am currently running Qwen3.6-30B in Ollama, through Cline to use as an agent in VSCode. Qwen's skill in coding is not in question, but the performance in VSCode is slow and inaccurate and times out

I don't have the ability to access Reddit posts or browse specific URLs. To provide you with an accurate factual summary for your knowledge base, I would need either: 1. The actual content/text from t

Hola Strix and AMD stacker frendios. Read the Lineage and Credits, this uses charlie12345/ROCmFPX, won't work on native llama.cpp yet. 122B total · 10B active · 60.70 GiB · 28.50 tok/s MTP-off · BF16

Benchmark Results Benchmark configuration: threads = 96 type_k = bf16 type_v = bf16 Llama-3.1-8B-Instruct Q8_0 Prompt Size GGML_CPU_Q8_0 t/s ZenDNN_Q8_0 t/s Gain 256 472.28 730.87 54.75% 512 450.86 83

https://youtu.be/oxpGq5FITgA?si=nkHWLReGCDYe7QfL I got Hermes running in the native Debian Terminal in Graphene OS and its really slick. Voice dictation works amazingly. Im using a remote Hermes gatew

Some fixes & boost(pp) for SYCL/Intel. Merged PRs: [SYCL] Flash Attention with XMX engine via oneDNN graph API (SDPA) on KV f16 for Xe2 ; Qwen3.6-27b-Q8_0 prefill speed up x1.21 at p=512 and x4.26 at

This post likely presents an enhanced demonstration of DVD-JEPA, a video variant of the Joint Embedding Predictive Architecture model. The JEPA framework has been extended to video tasks (V-JEPA) , an

A World of Warcraft server has become populated entirely by approximately 1,800 AI bots based on DeepSeek, which engage in typical player activities including chatting, leveling characters, running du

As of May 2026, image upscaling tools split into two main categories: true-to-source models optimized for photo restoration, and creative reimaginers designed for AI art. Leading options include Topaz

A developer created a Windows GUI tool for managing and benchmarking different llama.cpp builds, addressing the needs of AMD GPU users who work with multiple compute backends like Vulkan, ROCm, and HI

Ideogram 4 is an AI image generation model that features improved capabilities for creating text within images and generating visual content . The Reddit post likely showcases a comic or sequential ar

Fizgig, a tool for the Klein 9B model, has introduced 'LoRA Royale,' a new evaluation mode featuring epoch travel via morphing slider, seed travel, prompt travel, and LoRA strength travel capabilities

Forge Neo is an upgraded version of Forge UI built on the Gradio library , a lightweight Stable Diffusion web interface for image and video generation. It supports multiple new diffusion models includ

This post seeks guidance on configuring local AI infrastructure on an AMD-based Linux system (7900 XTX GPU with CachyOS), specifically covering the setup of large language models via Ollama, AI agents

A tiny Windows system tray tool that monitors local Ollama runtime with quick visual feedback about status, resource usage, and models . The app uses color-coded tray icons for quick status checks and

'Will Smith eating spaghetti' became a shorthand for early-stage AI video generation limitations , with the original 2023 clip generated with ModelScope showing distorted faces, morphed hands, and unn

Flux 2 Klein, the smaller quantized version of the Flux 2 image generation model, exhibits noticeable quality loss through VAE decoding artifacts that manifest as visual degradation in smooth gradient

PixelDiT is a 1.3B parameter diffusion transformer model that generates images directly in pixel space without requiring a VAE (Variational Autoencoder), representing an alternative approach to tradit

Ollama Cloud enables running large language models without a powerful GPU by offloading them to Ollama's cloud service . However, recent reports document significant reliability issues, including freq

A user reports difficulty creating an image of a bald green man using ChatGPT's image generation capabilities, likely related to limitations in the DALL-E model's ability to render certain character a

RTX 5060 Ti 16GB graphics cards were reported available for clearance at Best Buy for 300.99, while RTX 5070 Ti 16GB models were listed at 699.99 in-store. This post was shared on r/StableDiffusion, a

A user reports successfully running Qwen 3.6 35b MoE (mixture of experts) with Zoo Code on an M1 Max Mac, achieving local inference without external servers. The setup enables fully local, battery-pow

CineStill 800T Night Film LoRA is a machine learning model addon for Stable Diffusion that applies a cinematic night aesthetic to AI-generated images, using the trigger word 'c1n3st1ll' at strength 0.

Bonsai Image 4B is a family of compressed image-generation models available in 1-bit and ternary variants that reduces the footprint of a modern 4B-class diffusion transformer by up to 8.3x while pres

Ollama Talk is an Android app that connects to an Ollama server, enabling conversations with AI models like Llama and Mistral . The app features an intuitive chat interface with real-time conversation

This post discusses workarounds for content restrictions in Stable Diffusion, specifically showcasing examples of using the Director feature with LTX 2.3 model and alternative techniques to generate c

This project demonstrates a local AI system built with llama.cpp and Gemma 4 that captures and analyzes screen activity to create persistent memory of user computer interactions, enabling search, chat

AceStep 1.5 is a LoRA (Low-Rank Adaptation) model trained on the first two albums of the Modern Talking band, designed for use with Stable Diffusion image generation. This LoRA likely enables the gene

A user-generated AI image creation showcasing a deep space patrol scene rendered in 4K quality using Stable Diffusion, a popular text-to-image generation model. The post was shared on the r/StableDiff

This project implements a local desktop application using Qwen2.5-VL (a vision-language model) and Ollama that enables users to interactively query visual content on their screen through a live overla

LTX-2.3 is Lightricks' latest open-source audio-video generation model natively supported in ComfyUI, delivering major quality improvements including enhanced details, portrait video support, and impr

A vulnerability in DeepSeek's website exposed a significant amount of data, including user chats. A publicly accessible ClickHouse database belonging to DeepSeek allowed full control over database ope

Ollama offers several memory management settings, including the ability to reduce context length (context window) to decrease VRAM usage, which can save 0.2-0.4GB for 7-8B models when reduced from 8K