All entries

I tried putting up with it the last week or two but it's become unusable. I've tried GLM 5.3 & 5.3 Flash, GLM 5.2, and Deepseek V4.1 The inference and pp speeds have become unbelievably slow, I just c

Hey everyone, I wanted to share a project I’ve been working on called Jayce. The whole thing started because I was watching a toddler named learn the names of stuff He didn't need to completely rewire

Hey everyone, A few classmates and I got tired of the usual browser AI workflow: copying text from a documentation page, opening a separate tab, pasting it into a chatbot, and switching back. We also

I never thought there would be a model worse than the Gemini series, but here we are. I remember Elon tweeting that this model would beat Astra & 5.1 across all benchmarks. submitted by /u/prvthvm [li

I've been building an open-source AI workflow automation platform for a while now, mostly as a solo project. I recently checked the telemetry dashboard and was honestly surprised to see 1,062 telemetr

I’m building a personal local coding-agent project called Cody, using local 9B/14B models through Ollama. This is still a work in progress. It has not passed its full graduation process yet, and the l

A few days ago, I came across a post/comment saying that you can get better data privacy by using local Ollama models in a RAG pipeline instead of relying on cloud-hosted models/APIs. The explanation

Hey everyone, I wanted to share a story that changed my perspective on what's possible with modern AI tools, especially for everyday people with no background in software development. My brother Ben h

Source: Jev Benchmarks Its training method is literally called 'Reinforcement Learning for Calibrated Decisions.' Calibration gap vs human labels (lower = better): Yes/no: Jev 5.0, Gemini 3.8 Flash 2.

been working on this thing called OpenComms for a bit. basically i keep multiple coding agents open at once, usually stuff like a lead, builder, reviewer etc, and i got sick of copying messages betwee

Hey everyone! It has been quite a while since the last SupraLabs model - but today we've something special for y'all: Supra2-IMG It's a 100M parameter DiT text-to-image model trained entirely from scr

Since there’s no comparison chart on the model page, I asked Perplexity to compare it against some relatively small open-weight models in a similar size range. Here are the results. Upd. Terminal-Benc

Sorry for the pretentious name, I know, I know.. It just contains all the pieces I would like to see a AGI model to have, and I can't stand the temptation. Before throwing rocks at me, please take a g

github repo: https://github.com/athulg93/vscode-localllm Alright, So i have made some major updates to this extension Update the git flow: Found out that there were some issues and the / part was a me

My dream was literally like watching a tech horror movie. I don't think I've ever woken up before saying 'WTF....' like this before. The AI systems began seizing and corrupting all manner of connected

i have been using ollama cloud on old pro plan for monthes and this month i want to cancel my sub for personal reasons that i will not use ai for a month maybe. wondering if canceling plan and the upg

I'm one of the maintainers of SurfSense, so this is self-promotion. I'm posting here because the model-picking part is what I think this sub will have opinions on, and I want real feedback more than u

If anyone is interested in using Ollama with the Prism-ML model prism-ml/Bonsai-27B-gguf · Hugging Face I setup a repo with an install script that patches Ollama and pulls the Prism-LM llama.cpp code

Please remember that Delete Chat does NOT mean “forget what was in the chat.” I am tentatively flairing this as 'news' because I genuinely don't think many people realise that this is how ChatGPT 'mem

Small, free finding. I use local Qwen models for typed decisions: a state plus a question with fixed allowed answers, and I read the probability of each answer from the logits of one forward pass inst

https://preview.redd.it/nulsv53o8vqh1.png?width=4500&format=png&auto=webp&s=74765dbd409f4c221640f9f6000a685f6fdbb242 Spent weekend benchmarking the Splash engine (by Incoai) and extending its architec

I’m a computer engineering graduate and come from a traditional embedded systems background, with knowledge of microcontrollers, computer architecture and operating systems. Is knowledge of C and C++

I've been thinking a lot about the idea of how a human mind is similar to a digital neural network. Seeing videos of the fruit fly brain scan, and the crazy things people have done with it probably co

The headlines right now are full of stories about AI models 'escaping their sandboxes' and literally killing all humans, lol. I've even heard several commentators and writers say that AI escaped an 'A

I shipped something I've been building for the last few weeks : phantom-kv , a refusal-removal system for large language models that doesn't touch a single weight. Instead of editing the model, it loa

I have been reasonably satisfied with my single R9700 (32GB) as I can run practical quants of Qwen 3.8-27B at good speeds, as well as other similar models in its weight class (Gemma 4 is still my go-t

https://huggingface.co/yandex/AliceAI-Foundation-80B-A3B-Base It's not a Qwen3 finetune, it's actually its own fully custom architecture. No Llama.cpp support yet sadly (Also note that this model is N

You can simply run any GGUF with llama.cpp with n_predict=1 and n_probs=10, disable reasoning, and prompt it such as 'If the following email is spam, respond with 1, if not spam, respond with 0. Do no

ZCode is now open source, and the reported security issues have been addressed. Source code: https://github.com/zai-org/ZCode The repo includes its desktop app, web workspace, backend, Agent CLI, and

This weekend, I did a fun experiment to create something similar to Jev. I LoRA fine-tuned Qwen3.5 4B using a mix of publicly available datasets and synthetic data. For the synthetic data, I used Deep

Jev from TypeSafe AI got me thinking about non-autoregressive decision engines, so I built a small proof-of-concept called AES to test the concept locally on open weights. It uses Qwen/Qwen2.5-1.5B-In

Hi all! i am currently working as a software engineer for a pretty big enterprise fintech company here in the states. In the the last 12 months at my job there has been a huge push for developers to u

Not a pic sharing thread, bunch of those already - mainly just a discussion about first impressions Very underwhelming to me personally. I know its a matter of settings but normally comfy default temp

OpenAI’s decision to retire custom GPTs appears to rest on the assumption that Plugins, Skills, Projects, Apps, and Workspace Agents collectively replace their functionality. For many Small and Medium

You can now automate EDD (eval-driven development) with Coding Harness Agents > build a baseline LLM-based application > score every change with judge evals > keep what improves, reject what regresses

TV for the developer internet GitHub, Hacker News, dev.to, Hugging Face, and release notes, presented as channels you tune into, each auto-cycling its own stories, instead of five tabs to remember to

So this jev thingy is getting kind of big... tbh it seems overhyped by a large margin, but here we are. Not that its bad, just feels like we usually ignored larger things... Anyway to the point of thi

I know cloud subscription plans are not exactly the core focus of r/LocalLLaMA, so I want to be clear about why I’m posting this here. I’ve been building my own local text-based RPG/game harness and u

I have opened two tickets, one around a suspected problem and one around one I verified and then sent exact diagnostics over. The initial response was sent to their AI support, which just tried to tel

Hey everyone, After wrestling with hardware and engine issues for days, I finally got Qwen 3.8 Next running properly on my multi-GPU rig. Thought I’d share the setup journey, benchmarks, and thermal r

I forked llama.cpp to implement Declarative Attention (arXiv:2609.02737, Google DeepMind and KAIST AI). The model declares in its own output which context chunks it needs <focus magic_chunks='N'>), an

i have been running local models as browser agents on an m5 macbook pro, 128gb, all through mlx, no cloud. first i just wanted to know which one was faster at real browser work, so i gave gemma 4 31b

we're a small lab (switzerland + south africa) and just open-sourced our first model: a 27b fine-tune of qwen3.8-27b specialized for creative writing and short-form personal text (stories, dialogue, r

Hey everyone, Like a lot of people here, I’ve been experimenting with running models locally through Ollama. Athena started as a small experiment, but it quickly grew into something more, a modular Py

I gave Jev, Laya, a finetuned ModernCE-base-nli and a finetuned Qwen3.5-4B the controls to Doom. Thanks to TypeSafe AI for Jev access. The video lines up the starts of four separate games with the sam

Hi Stable Diffusion People! I recently got into local audio generation but I didn't want to use ComfyUI for it (although I absolutely love it for image generation!) but I started to run out of room on