All entries

Someone recommended that I try the ByteShape Qwen 3.8 27B IQ3-XXS GGUF after seeing my previous testing of the GSQ quant. So I did. And the result was… surprisingly bad. For context, I'm running: RTX

I've trained a preliminary lora to fix the image generation issues with Qwen Image 2.1 (also drastically improving edit quality). I've also been doing a lot of a/b testing with negative prompts and va

I didn't know my set up was outperforming nearly everyone until reading another discussion where people were struggling getting half of that speed with half the context on the same hardware. I benchma

Github: https://github.com/OpenEuroLLM/ComplexKDA HuggingFace: https://huggingface.co/collections/openeurollm/complexkda Arxiv: https://arxiv.org/abs/2609.24797 Authors: Julien Siems*, Riccardo Grazzi

🚀 THE EDGE AI FAMILY HAS ARRIVED. Today we’re opening the doors to a new generation of open-source and open-weight edge AI models from Next GenAi. Meet Rebekah AI 1.8B. 🧠⚡ Small enough to run at the e

Our most recent work at Templar explores fault tolerance in Crucible, our distributed pre-training platform. The goal is to keep healthy workers training when another pipeline stage goes offline. Cruc

Tibo said Tuesday, GPT-6 Sol is suddenly everywhere, and now Claude Opus 5.5 leaks are blowing up too. Yet… nothing so far. 😂 At this point I’m just refreshing X like it’s a live event. What do you th

I keep replaying that night in my head because we came way too close to doing nothing. We were eating dinner when my dad dropped his chopsticks. He picked them up, dropped them again, then got annoyed

There's quite a lot of public anti-AI sentiment at the moment, but a lot of the most common concerns and objections have to do with the politics, economics and ethics of datacenter-based AI. So, when

I asked this back in 2025, but the AI landscape has changed a lot since then. Not looking for the usual ChatGPT, Claude, Gemini, Midjourney, etc. I'm curious about the lesser-known tools that you actu

https://preview.redd.it/ybwqqbrst0rh1.png?width=811&format=png&auto=webp&s=1e40c5b53e304caf2a10efa2baa6f998b9a9a0bb MiMo-V2.6-Distill-Qwen-9B is a 9B agentic model developed by Xiaomi MiMo through sup

This sub is, needless to say very niche and skewed towards the high end. There are tons of extremely high end setups here with multiple gpu's etc. Even 24GB is out of reach of most people financially,

https://preview.redd.it/5aon65uosrqh1.jpg?width=1000&format=pjpg&auto=webp&s=cd21ce0648b0ffa5dc07e66718a230f1f91d8a53 I have a GMKtec EVO-X2, it doesn't have oculink nor pcie slots, but it does have 2

This experiment is live, you can inspect all the internal reasoning, memories, attempts here: https://artificium-covering-experiment.gr.bio/ The problem that the agent is trying to solve is a covering

I’ve been working on making small models more capable at agentic coding and work, because most people in the world don’t have the sort of hardware needed to run 3.8-27B, or even 35B-A3B or 9B dense, a

I'm working on a computer game as a side project. I started it around 4 years ago, before I used any AI for coding. For most of that time I wrote everything myself. Later I started using GitHub Copilo

I decided to do this experiment to see what would be the ability of an LLM model to, in a single shot, transfer the knowledge it may or may not have about that artist/brand/designer/animator to a comp

https://preview.redd.it/qs228wu19yqh1.png?width=1192&format=png&auto=webp&s=76b02d846c09049c536c4e64411d5c26167e0bd7 Tried to use chat to help with an assignment, and it linked this super sketchy webs

Laya is an open-weight (Apache 2.0) 'System 1' decision model from Convai Innovations, built by Nandakishor M as an open alternative to TypeSafe's closed Jev API. Instead of generating text, it takes

Quote: DeepSeek is training a 2T-parameter model and plans to eventually build an 8T-parameter model. https://x.com/wallstengine/status/2101982843656388644 Current DeepSeek models: Flash parameter cou

Having a blast with Qwen Image 2.1 on my M2 Macbook Pro with 32GB RAM, even though it takes 16 minutes to complete the recommended number of iterations with the resolution reduced to 1024x1024. And th

# the What An engine to run Gemma 4 31B on blackwell under massive concurrency and rather specific workload patterns. I've been waiting for someone to do ninfer but for gemma, and, well, ended up havi

Hi all! After all the jev hype I wanted to try by myself and got qwen3.8 27b to mix-and-match open implementations on top of ninfer, and to be honest I'm quite impressed with the results, latency is n

I want to try using AI to find possibly overlooked interventions for irritable bowel syndrome (IBS) and create a cocktail of interventions that AI thinks would give the highest expected benefit, attac

What if you don’t need a new model to get Jev-style decisions? I built hearim(헤아림. hea-a-rim. not Here, I am.. lol), an open-source gateway that turns ordinary local or hosted LLMs into a Jev-compatib

https://preview.redd.it/d7brwofkhuqh1.png?width=1400&format=png&auto=webp&s=9a0079ebc2710faff9a73378dac58c6dd67e3cec link: https://huggingface.co/Altworld/Hemmingway-1 submitted by /u/paf1138 [link] [

I tried putting up with it the last week or two but it's become unusable. I've tried GLM 5.3 & 5.3 Flash, GLM 5.2, and Deepseek V4.1 The inference and pp speeds have become unbelievably slow, I just c

Hey everyone, I wanted to share a project I’ve been working on called Jayce. The whole thing started because I was watching a toddler named learn the names of stuff He didn't need to completely rewire

Hey everyone, A few classmates and I got tired of the usual browser AI workflow: copying text from a documentation page, opening a separate tab, pasting it into a chatbot, and switching back. We also

I never thought there would be a model worse than the Gemini series, but here we are. I remember Elon tweeting that this model would beat Astra & 5.1 across all benchmarks. submitted by /u/prvthvm [li

I've been building an open-source AI workflow automation platform for a while now, mostly as a solo project. I recently checked the telemetry dashboard and was honestly surprised to see 1,062 telemetr

I’m building a personal local coding-agent project called Cody, using local 9B/14B models through Ollama. This is still a work in progress. It has not passed its full graduation process yet, and the l

A few days ago, I came across a post/comment saying that you can get better data privacy by using local Ollama models in a RAG pipeline instead of relying on cloud-hosted models/APIs. The explanation

Hey everyone, I wanted to share a story that changed my perspective on what's possible with modern AI tools, especially for everyday people with no background in software development. My brother Ben h

Source: Jev Benchmarks Its training method is literally called 'Reinforcement Learning for Calibrated Decisions.' Calibration gap vs human labels (lower = better): Yes/no: Jev 5.0, Gemini 3.8 Flash 2.

been working on this thing called OpenComms for a bit. basically i keep multiple coding agents open at once, usually stuff like a lead, builder, reviewer etc, and i got sick of copying messages betwee

Hey everyone! It has been quite a while since the last SupraLabs model - but today we've something special for y'all: Supra2-IMG It's a 100M parameter DiT text-to-image model trained entirely from scr

Since there’s no comparison chart on the model page, I asked Perplexity to compare it against some relatively small open-weight models in a similar size range. Here are the results. Upd. Terminal-Benc

Sorry for the pretentious name, I know, I know.. It just contains all the pieces I would like to see a AGI model to have, and I can't stand the temptation. Before throwing rocks at me, please take a g

github repo: https://github.com/athulg93/vscode-localllm Alright, So i have made some major updates to this extension Update the git flow: Found out that there were some issues and the / part was a me

My dream was literally like watching a tech horror movie. I don't think I've ever woken up before saying 'WTF....' like this before. The AI systems began seizing and corrupting all manner of connected

i have been using ollama cloud on old pro plan for monthes and this month i want to cancel my sub for personal reasons that i will not use ai for a month maybe. wondering if canceling plan and the upg

I'm one of the maintainers of SurfSense, so this is self-promotion. I'm posting here because the model-picking part is what I think this sub will have opinions on, and I want real feedback more than u

If anyone is interested in using Ollama with the Prism-ML model prism-ml/Bonsai-27B-gguf · Hugging Face I setup a repo with an install script that patches Ollama and pulls the Prism-LM llama.cpp code

Please remember that Delete Chat does NOT mean “forget what was in the chat.” I am tentatively flairing this as 'news' because I genuinely don't think many people realise that this is how ChatGPT 'mem

Small, free finding. I use local Qwen models for typed decisions: a state plus a question with fixed allowed answers, and I read the probability of each answer from the logits of one forward pass inst