Search: “people”

Hey folks — I built ContextMemory, an open-source agentic context gateway for apps that already talk to LLMs. The idea is simple: keep your existing POST /api/chat client (Ollama wire format), point i

I got tired of my Ollama server sitting idle between chat experiments, so I pointed it at my Navidrome library and made it run a radio station. The DJ is an agent, not a shuffler. Each turn it gets to

Running local models means every token counts — an 8K or 16K window fills up fast when you're stuffing graph context into prompts for RAG. I benchmarked 10 graph serialization formats (JSON, GraphML,

Qwen3.6-27B: SFT vs continued pre-training vs RL? I’m interested in adapting Qwen3.6-27B, but I’m increasingly unsure whether conventional SFT/LoRA is the best route if the goal is to add a capability

Hey r/LocalLLaMA — maintainer here, obviously biased. OpenSmith is an open-source Python tracing tool for LLM pipelines. The idea: drop u/trace on any function, run opensmith ui, get a full local dash

Hi everyone, I have a system which I have been using for gaming, R7 5700X, 48GB DDR4, RTX3090 24GB. But I want to use it for Local AI to reduce my reliance on cloud AI providers (mainly usage limits -

Hi everyone! Over the past five months I've been working on DKV (DifferentialKV), an open-source project exploring KV-cache compression for long-context local LLM inference. The goal is to reduce KV-c

I’ve spent the past month trying to find the point where an extremely small TTS model stops feeling like a size experiment and starts feeling genuinely useful. Today I’m releasing Inflect v2, with two

like 8 months ago I was tinkering with both and gemini was so much better i went with that. I had a project at work that I needed an AI to sift through a manual and schematic for and no matter what, g

Quantized Krea 2 Turbo checkpoints for ComfyUI, up to 2x faster and about a third smaller than the usual FP8 version — no calibration dataset, no quality cliff. How to use it (short version): clone th

Please be honest. I would love to hear about guys really dedicated to local AI and who really reject subscriptions (especially to openai and anthropic). What do you use your model for? submitted by /u

https://preview.redd.it/b7ybs7nqx5fh1.png?width=3440&format=png&auto=webp&s=e6aaaa15cbe59debaae1ebb7fcd708167e86dc35 Hey r/LocalLLaMA ! We are back and we have something really amazing today. Our big

Hey all, I’ve been working on this in my spare time and finally feel ready to share it outside my own circles. Arbiter is a single binary for running agents locally. I originally built it because I wa

If you're running Laguna S 2.1 on llama.cpp and hitting thinking loops because it won't close its </think> tags, you might want to look at your quant before you spend too much time tweaking settings.

TL;DR: Everyone says QLoRA past ~13B is dead on a 24GB card. I got the full 32B FLUX.2 dev transformer QLoRA-training resident on the GPU on a 7900 XTX under native ROCm on Windows (no ZLUDA, no CUDA

Today the Department of Energy (DOE) and Arcee AI announced the development of Genesis-Science-1 (GS1), an open model for scientific research. This is a joint effort to bring advanced AI into scientif

TL;DR: I’m reproducing the trait-persistence result from arXiv:2606.24014 on one RTX 3090. Before I can test persistence I need to install a trait via RL — and my GRPO run moves the trait only +2.4 po

Two DGX Spark and a Connect-X7 cable give you about 250GB of usable memory for 7000 8000 USD. This allows using some interesting models at 4-bit. For what seemed like an eternity, the only serious mod

Codex Mobile is now available in preview on iOS and Android across all ChatGPT plans, including Free and Go, in all supported regions. The feature allows developers to follow and steer Codex while it

This is a hypothetical discussion thread from r/ChatGPT exploring the absurd scenario of replacing all Earth's water with lemon-flavored ice tea, likely featuring creative speculation about biological

A researcher on r/MachineLearning built a political benchmark to evaluate how various LLMs handle sensitive geopolitical and politically contentious questions. Key findings include that Kimi K2 (Moons

A Reddit post on r/ChatGPT expressing user frustration with the word 'grounded' being overused in ChatGPT's responses, reflecting a broader community complaint about repetitive, AI-characteristic lang

A Reddit post from the r/ChatGPT community in which a user shares their experience of asking ChatGPT to evaluate their intelligence, likely showcasing the AI's response. The post probably highlights h

This Reddit post is part of the viral trend of using ChatGPT's AI image generator to humorously alter pet photos — in this case, asking it to superimpose human teeth onto a cat. The broader trend invo

A Reddit post from the r/ChatGPT community in which a user shares how experimenting with ChatGPT for a single, unplanned task led to them becoming a habitual user of the tool. The post likely resonate

A Reddit user on r/ChatGPT shared a cautionary real-world experience using RunLobster, an AI agent tool, for customer communication — the AI drafted a reply to an angry customer that mirrored her aggr

This Reddit thread from r/ChatGPT invites community discussion around the common experience of anthropomorphizing ChatGPT — that is, attributing human-like qualities, emotions, or intentions to the AI

Yes, it is possible to rank in both traditional SERP results and Google AI Overviews simultaneously. Google pulls content sources from its index before determining rankings or SERP features, meaning t

This r/StableDiffusion post asks whether AI tools can automatically generate and apply sound effects to videos, using a vivid example of a zebra eating bamboo with explosive, comedic audio results. Se

This Reddit post examines the true total cost of running OpenClaw, an open-source AI agent framework, across different deployment models. While OpenClaw itself is free and open-source, hosting costs r

A Reddit post on r/StableDiffusion in which a user shares a music video created entirely using AI-generated imagery produced on their own local hardware, likely using tools such as Stable Diffusion wi

A Reddit post in the r/ChatGPT community went viral after a user shared their experience of using ChatGPT to better understand a medical diagnosis, finding the AI more helpful than a brief four-min...

HappyHorse-1.0 is a pseudonymous AI video generation model that appeared on April 7, 2026, topping the Artificial Analysis Video Arena leaderboard in both text-to-video and image-to-video (no audio...

I was unable to retrieve the specific Reddit post at the provided URL through my search. The post (reddit.com/r/StableDiffusion/comments/1shxmfk) did not surface in the search results, and I cannot...

HappyHorse-1.0 is an AI video generation model that anonymously appeared on the Artificial Analysis Video Arena leaderboard in early April 2026, where both its V1 and V2 versions rapidly climbed to...

I was unable to retrieve the specific Reddit post from the URL provided, and I don't have direct browsing capability to fetch URLs. The web search also did not return results for that specific post...

LTX-2.3 is a DiT-based audio-video foundation model from Lightricks that generates synchronized video and audio within a single model pass, representing a significant upgrade over LTX-2 with improv...

A Reddit post in the r/StableDiffusion community showcasing a lip sync music video clip generated using LTX 2.3 — Lightricks' open-source AI video model — synchronized to Drake's 'Toosie Slide.' L...

I was unable to retrieve the specific Reddit thread content from the URL provided. The search results did not surface the actual post or its comments from r/MachineLearning (post ID: 1shibc9). Redd...