Search: “tools”

Most quantization works like this: pick a bit depth, apply it everywhere, maybe let imatrix take a rough guess at what matters, ship it. Most don't check which specific weight groups can take a hit an

A developer created a terminal user interface (TUI) tool that enables local large language models (LLMs) running on Ollama or cloud platforms to debate each other as a method for detecting and reducin

This post describes a visualization tool that provides real-time insight into GPT-2's internal processing by displaying concept activations as a 3D graph, with each token generation showing which neur

A developer created a visualization tool that displays GPT-2's internal concept activations in real-time during text generation, representing the model's 'thinking' process as a 3D graph that updates

A community developer shared a custom-built tool on r/StableDiffusion that leverages diffusion model technology — typically used for AI image generation — to generate user interface (UI) designs or co

This r/StableDiffusion thread seeks community recommendations on AI image generation tools, reflecting a common discussion in the subreddit where users compare options like Stable Diffusion (run local

Vheer is an img2img tool shared on the r/StableDiffusion community, likely a web-based or standalone application that leverages Stable Diffusion's image-to-image generation capabilities to transform e

OpenAI’s decision to retire custom GPTs appears to rest on the assumption that Plugins, Skills, Projects, Apps, and Workspace Agents collectively replace their functionality. For many Small and Medium

I've been working on something for this community (and other self-hosted communities) for almost 5 months now. Personally, I would grade it as probably the closest open source equivalent of Manus and

So this is maybe a niche problem, but at my job I work on a huge Python codebase and every time I change some shared function I'm basically playing roulette. grep tells who mentions it in the code bas

I built a free tool that lets your coding agent make videos like this one. You give your agent the link to the repo and say what the video should be about. It writes the words, draws the scenes, and y

https://github.com/paulknysh/raggy A lightweight CLI tool for Retrieval-Augmented Generation (RAG) over local documents built with Ollama. Hybrid database (vector + BM25 index) and embedding generatio

A tiny Windows system tray tool that monitors local Ollama runtime with quick visual feedback about status, resource usage, and models . The app uses color-coded tray icons for quick status checks and

A Reddit user on r/ChatGPT shared a free tool designed to help users work around ChatGPT's image upload limits by automatically merging multiple clipboard images into a single combined grid before upl

A Reddit discussion thread on r/MachineLearning in which practitioners explore how foundational concepts from Sutton and Barto's *Reinforcement Learning: An Introduction* — including MDPs, policy g...

Hi everyone! I’m an intern at Icosa, a startup focused on making local AI accessible. We just released the first version of Zeno, our local AI product, and I thought it might be of interest to this co

Hey everyone, Posted TinySearch here a few versions ago and got a bunch of useful feedback, so figured I'd post an update because the thing has changed quite a bit since then. Repo: [https://github.co

This Reddit post discusses the challenge of manually editing tag files (.txt) when training a LoRA (Low-Rank Adaptation) model for Illustrious, noting that while CivitAI's LoRA trainer offers a conven

ComfyUI is an open-source platform for creative AI that has become widely used by millions of artists, developers, and studios to create images, videos, 3D assets, and audio. The company raised $17 mi

This r/ollama thread discusses how to run a local, free alternative to Claude Code for CLI-based AI coding using Ollama. Ollama v0.14.0 and later are compatible with the Anthropic Messages API, making

CorridorKey is an open-source AI chroma keyer released by the team behind Corridor Crew, a popular VFX YouTube channel, designed to solve complex problems in video compositing. Users input raw green s

Hi everyone! So far in 2026 I have been iterating and evolving a research system I designed to help me sift through things that LLMs all agree on that may not be correct, and to give me actual confide

been working on this thing called OpenComms for a bit. basically i keep multiple coding agents open at once, usually stuff like a lead, builder, reviewer etc, and i got sick of copying messages betwee

Hi Ollama Team, I’m writing regarding the announced retirement of GLM-5.1 from Ollama Cloud on 25 September 2026. I wanted to provide some fairly detailed technical feedback because GLM-5.1 is not sim

Now, some of you might not believe me from the get go, and it's completely fine, But for those who are willing to give Tap a chance, a whole new world of voice dictation is going to unlock for you. Ta

'Again?' you might ask. I(*) took the original Qwen 27B 3.8 chat template and compared it to the improved template that was posted a day before. The original has issues. The improved one fixed some wh

Ollama exposes an Anthropic-compatible Messages endpoint , allowing developers to run powerful open-source AI models locally with no API costs and pair them with Claude Code for a capable local AI cod

A developer created a local Model Context Protocol (MCP) memory server that integrates Ollama to provide AI coding assistants with persistent memory capabilities while maintaining complete privacy and

This project implements a local desktop application using Qwen2.5-VL (a vision-language model) and Ollama that enables users to interactively query visual content on their screen through a live overla

LTX-2.3 is Lightricks' latest open-source audio-video generation model natively supported in ComfyUI, delivering major quality improvements including enhanced details, portrait video support, and impr

I run local LLMs pretty much around the clock, but I also enjoy gaming on the same PC. Having models sitting in VRAM while gaming isn't exactly ideal, and constantly unloading and reloading them manua

CrowdStrike report: https://www.crowdstrike.com/en-us/blog/unknown-threat-actor-uses-artex-to-target-south-korean-finance/ From: Andrew Curran on 𝕏: https://x.com/AndrewCurran_/status/2108108695876092

Hello r/localllama once again, it's me your kobold concedo Been a few months since I last posted here, and today I have something new I'd like to share. Specifically, KoboldCpp now ships with a built-

In light of recent events and media coverage, ai is in the spotlight and people are afraid. How I respond to those fears: If you are afraid of ai then you should also be afraid of all medical research

Hey all, Henry from Cactus Compute here, I kinda wanted to share our latest model and get feedback from the family :) Needle 3 is a small foundation model for automation: you give it the functions you

It supports images and full videos, native resolution NR or DLSS Super Resolution upscaling by scale factor / target resolution, GPU optical-flow motion vectors, scene cut handling, and all DLSS 5 NR

I read this somewhere and wasn't sure if it's still an issue or if it only affects external models versus all models used via the Claude Code CLI. 'This latest Ollama update finally fixes that issue w

I'm working on a local perplexity/AI search comprised of a custom harness and a further trained model. LFM 2.6 is almost to spec with no additional training, it is very good. submitted by /u/thebadsli

TL;DR: I am building a Windows-first local AI setup for people who want to try local LLMs without spending days choosing models, setting up Ollama, Docker, WSL, Open WebUI, agents, and tool permission

Is anyone here successfully running DeepSeek-V4-Flash-0731 locally with vLLM, especially on AMD MI325X? My setup: GPU: 1x AMD Instinct MI325X Model: deepseek-ai/DeepSeek-V4-Flash-0731 vLLM: 0.26.0 ROC

I have been working on this tool for months and there are a lot of new functionalities and tests that are going to be released in the next few weeks! The goal of the tool is to allow community members

I've tried grok and Claude's deep research mode and I was amazed with the speed considering the amount of sources analysed. Is there anything as fast that can run locally? My guess would be that to ru

This r/ChatGPT thread discusses how job seekers are leveraging ChatGPT throughout the job search process, including tailoring resumes and cover letters to specific job descriptions, preparing for inte

A Reddit thread from r/ChatGPT in which users discuss their personal relationship with ChatGPT — whether they interact with it in a casual, conversational, and emotionally engaged way (as they might w

I’m building a Polish General purpose legal Model that drafts documents, answers questions using legal sources, and has enough coding ability to handle some automation. The workflow is very tool-heavy

EXL3 is an alternative to llama.cpp. And while there is extensive tooling for llama.cpp, EXL3's primary deployment (TabbyAPI), has a OpenAI compatible API so it shouldn't matter. Why won't this tool m