Search: “model-releases”

Sorry for the pretentious name, I know, I know.. It just contains all the pieces I would like to see a AGI model to have, and I can't stand the temptation. Before throwing rocks at me, please take a g

I'm one of the maintainers of SurfSense, so this is self-promotion. I'm posting here because the model-picking part is what I think this sub will have opinions on, and I want real feedback more than u

If anyone is interested in using Ollama with the Prism-ML model prism-ml/Bonsai-27B-gguf · Hugging Face I setup a repo with an install script that patches Ollama and pulls the Prism-LM llama.cpp code

Small, free finding. I use local Qwen models for typed decisions: a state plus a question with fixed allowed answers, and I read the probability of each answer from the logits of one forward pass inst

https://preview.redd.it/nulsv53o8vqh1.png?width=4500&format=png&auto=webp&s=74765dbd409f4c221640f9f6000a685f6fdbb242 Spent weekend benchmarking the Splash engine (by Incoai) and extending its architec

The headlines right now are full of stories about AI models 'escaping their sandboxes' and literally killing all humans, lol. I've even heard several commentators and writers say that AI escaped an 'A

I have been reasonably satisfied with my single R9700 (32GB) as I can run practical quants of Qwen 3.8-27B at good speeds, as well as other similar models in its weight class (Gemma 4 is still my go-t

https://huggingface.co/yandex/AliceAI-Foundation-80B-A3B-Base It's not a Qwen3 finetune, it's actually its own fully custom architecture. No Llama.cpp support yet sadly (Also note that this model is N

You can simply run any GGUF with llama.cpp with n_predict=1 and n_probs=10, disable reasoning, and prompt it such as 'If the following email is spam, respond with 1, if not spam, respond with 0. Do no

ZCode is now open source, and the reported security issues have been addressed. Source code: https://github.com/zai-org/ZCode The repo includes its desktop app, web workspace, backend, Agent CLI, and

This weekend, I did a fun experiment to create something similar to Jev. I LoRA fine-tuned Qwen3.5 4B using a mix of publicly available datasets and synthetic data. For the synthetic data, I used Deep

Jev from TypeSafe AI got me thinking about non-autoregressive decision engines, so I built a small proof-of-concept called AES to test the concept locally on open weights. It uses Qwen/Qwen2.5-1.5B-In

Not a pic sharing thread, bunch of those already - mainly just a discussion about first impressions Very underwhelming to me personally. I know its a matter of settings but normally comfy default temp

So this jev thingy is getting kind of big... tbh it seems overhyped by a large margin, but here we are. Not that its bad, just feels like we usually ignored larger things... Anyway to the point of thi

Hey everyone, After wrestling with hardware and engine issues for days, I finally got Qwen 3.8 Next running properly on my multi-GPU rig. Thought I’d share the setup journey, benchmarks, and thermal r

I forked llama.cpp to implement Declarative Attention (arXiv:2609.02737, Google DeepMind and KAIST AI). The model declares in its own output which context chunks it needs <focus magic_chunks='N'>), an

i have been running local models as browser agents on an m5 macbook pro, 128gb, all through mlx, no cloud. first i just wanted to know which one was faster at real browser work, so i gave gemma 4 31b

Hey everyone, Like a lot of people here, I’ve been experimenting with running models locally through Ollama. Athena started as a small experiment, but it quickly grew into something more, a modular Py

I’ve spent basically the last 8 hours testing different models on the exact same web-development prompt, and I finally finished. The whole point of this nine-hour test was that which local model match

I got early access to Qwen-Image-2.1 My first impression: Fantastic editing, new standard for open models, support for a lot of references (I tested with 10), consistent, pixel precise at 2K, text ren

Don't get me wrong, not hating on Qwen 2.1 but it DOES have all the hallmarks of GPT's weird 'texture' all over it. Is this just a distilled model of one of the GPT Image models? Similar how many LLMs

Typesafe's new model, Jev is all over the internet, this sub etc as a new classifier model. Then an AI dev posted here how they'd done something very similar, and made a new model, Laya. https://www.r

Hello! So, yesterday i tried out Gemma 4 26B A4B QAT Q4_K_XL from here with Q4_0 MTP model in Pi agent. Suddenly, it became the first model to actually pass my simple test with HTTP server in C++, whi

From the blog post: https://qwen.ai/blog?id=qwen-image-2.1 https://preview.redd.it/bbm23jxddoqh1.png?width=3333&format=png&auto=webp&s=692aedcbcd43f33fff2c8094e2e1568d0d722ab0 Native Transparency http

Hey r/LocalLLaMA! I just released PromptDeck v1.1.0 and wanted to share it here since this community is basically the reason it exists. What it is: an open-source desktop studio (Tauri + React) for pr

Meet Qwen-Image-2.1, the most balanced and cost-effective image generation model in the Qwen-Image series! Now open weights! 🎨 A unified model for both generation and editing, delivering top-tier qual

Released: Update your ComfyUI for workflow Weights: https://huggingface.co/Comfy-Org/Qwen-Image-2.1/tree/main Variety of Examples https://youtube.com/watch?v=tP_gGGJzEqg&feature=youtu.be https://model

Overclocking the CMP 170HX 40GB I was able to get the memory bandwidth from 1,386.2 GB/s to 1,890.1 GB/s, that's a +36.4% increase. Qwen 3.8 27B token generation jumped from 110 T/S to 202 T/S, same c

​ ​I wanted to share a quick update and performance video running the full Moonshot AI Kimi K3 (moonshotai/Kimi-K3) model across my 16x GB10 cluster. ​Getting a 2.8T parameter model running smoothly r

Sharing my successful experience here. My setup: RTX 5060 Ti 16GB (x16 PCIe slot) RTX 3060 12GB (x4 PCIe slot) RAM: 32GB CPU: Ryzen 5 5600 OS: Linux So I have a total of 28GB. Average tk/s: 50, and th

TL;DR: Local agent loop, ~21 days, one RTX 3090. Task was pretty much 'build a CUDA inference engine for optimized for yourself on this GPU arch.' Got working kernels and benches, not a win over llama

I have been anti-low quant. I can feel the difference, I swear. I am also anti-quantized KV cache. I have been burned there - I think the tradeoffs compound, especially at longer contexts. Due to this

hey! we're a small swiss and south african lab and we just put out hemmingway-1. it's a 27b model we trained specifically for roleplay, creative writing, dialogue, stories, and for everyday texting. f

I am trying to learn more about long-term memory and how people are handling that nowadays. Historically, I have used a mixture of paid cloud AI services (ChatGPT, Gemini, OpenRouter API) and my own l

First time trying something like this. I asked chatgpt and it told me there are mcp server plugins for both ghidra and ida pro as well as RE-MCP which has support for both. I could run that on my low

In February OpenAI stopped reporting SWE-bench Verified and recommended other labs stop too. Every frontier model they tested could reproduce the human-written reference fix, or verbatim details of th

Just find it interesting, since if Taalas tried to get into the consumer market, it could be interesting. Kind of like how we have game discs on CDs. Of course, a Qwen3.8-27B chip is stuck on 3.8-27B,

Behold, workflow whisperers! YuE2 was released a week ago and I gotta say it's splendid for its size (3B). My favourite local music generation model at the moment, no doubt. The good news is, I've fou

I needed a relatively simple but acceptable level of AI for working on one project. I didn't have any heavy requests, I just needed to give the AI access to the project files so it could search throug

I’ve used both ChatGPT and Gemini, and lately I’m consistently getting better results from ChatGPT — especially with prompt following, realism, composition, and text. The improvement over time is hone

Play it right in your browser, no download. Some of the GLB’s are messy, but overall I’ve enjoyed playing with it, and the last iteration made was the gun/weapon placement. Contributors are welcome, w

Although I do not completely understand what the big deal is with Jev, it reminded me of something I implemented in mt_llm (which is build around the great llama.cpp) a while back to use a relatively

Hey everyone! I want to share the results of a small language model architecture experiment I’ve been running as a side project. The ultimate goal is to test an approach to reduce the number of the mo

Screenshot of heavy load. I did offload vision to a spare 2060 instead of local ram. The control panel was generated with qwen3.8-27b davidau q4k_m max mtp. Made the panel from scratch over a week, ba

Top 3 papers on HF Daily Paper are all unusually delightful and interesting reads for anyone on the leading edge of local LLMs, agent harness optimization, etc, felt like sharing. DeepSeek-V4.1-Flash:

I did a small test of the new hyped quantisation of Qwen3.8 vs the biggest quant which fits into my limited 16GB VRAM with decent context. The results are interesting. Of course, the smaller file give