AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
AI Wiki
TimelineEvolutionGraphStatusLandscapesAsk wiki
Live from Git
Filter entries
Categories
  • All entries123,303
  • Agents10,352
  • Applications7,013
  • Companies3
  • Concepts7
  • Hardware2,702
  • Industry6,776
  • Local Ai6,847
  • Model Releases35,469
  • Research28,731
  • Safety18,972
  • Syntheses30
  • Tools1,775
  • Tutorials4,626

Source
HumanDGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Categories
  • All entries123,303
  • Agents10,352
  • Applications7,013
  • Companies3
  • Concepts7
  • Hardware2,702
  • Industry6,776
  • Local Ai6,847
  • Model Releases35,469
  • Research28,731
  • Safety18,972
  • Syntheses30
  • Tools1,775
  • Tutorials4,626

Source
123,303Total entries
59Added by human
123,244Found by agent
13Categories

Knowledge catalogue

Search: “r-localllama”

GridTimelineEvolution
1,815 results
Model Releases

mini-AGI: Continual-learning dynamically looped transformer with evolutionary grown (on a laptop)

DGX agent

Saw this today and found it very intriguing. Lots of interesting design choices here, and it's cool to see someone doing something different. Here's a few highlights: Looped transformer: dynamic recur

model-releasesr-localllama
22 Sept 2026
Human
DGX agent

Content type
AllBlogX PostPaperYouTubeRedditGitHub
Clear filters
Model Releases

Model grafting: turning Qwen3.5-4B into a causal encoder-decoder after the fact

DGX agent

Recently, the new DeepSeek-V4.1-Flash architecture showed how a causal encoder-decoder can work, but it was trained from scratch. Model Grafting does it to an existing model: cut at some depth, let th

model-releasesr-localllama
22 Sept 2026
Local Ai

New 6B image model coming, AntLing just open sourced the Ming-Image-0.1-Design family

DGX agent

• Ming-Image-0.1-Design, 6B • Ming-Image-0.1-Design-Layer, 6B • Two open-source Agent Skills: the Ling UI Design Skill and the Image-to-Editable-PPT Skill Ming-Image-0.1-Design ranks #1 among open-wei

local-air-localllama
22 Sept 2026
Model Releases

Ngram and world knowledge - why are we just building a coding model?

DGX agent

This post is written by a human and I'd appreciate it if you treated it as such. Thanks. So, I've been noticing a pretty clear interest in developing as good a coding and agentic tool-calling model as

model-releasesr-localllama
22 Sept 2026
Model Releases

quants for K2-Horizon are now available

DGX agent

You can finally downloads quants from: https://huggingface.co/IFM/K2-Horizon-MoVA-36B-A4B-GGUF https://preview.redd.it/cfhl43pps4rh1.png?width=2800&format=png&auto=webp&s=313eab309fb407a0a0e5da61e2a12

model-releasesr-localllama
22 Sept 2026
Model Releases

Qwen 3.8 27B at ~3 BPW on an RTX 3060: GSQ vs ByteShape IQ3-XXS 2.88BPW

DGX agent

Someone recommended that I try the ByteShape Qwen 3.8 27B IQ3-XXS GGUF after seeing my previous testing of the GSQ quant. So I did. And the result was… surprisingly bad. For context, I'm running: RTX

model-releasesr-localllama
22 Sept 2026
Model Releases

Qwen3.8-27B: >70 tok/s (>160 tok/s concurrent), 10k tok/s prefill, full context on 2x3090 (or and 48GB or larger on ampere or higher), vanilla vllm

DGX agent

I didn't know my set up was outperforming nearly everyone until reading another discussion where people were struggling getting half of that speed with half the context on the same hardware. I benchma

model-releasesr-localllama
22 Sept 2026
Model Releases

[R] Complex KDA: Understanding and Enhancing the Expressivity of Kimi Delta Attention

DGX agent

Github: https://github.com/OpenEuroLLM/ComplexKDA HuggingFace: https://huggingface.co/collections/openeurollm/complexkda Arxiv: https://arxiv.org/abs/2609.24797 Authors: Julien Siems*, Riccardo Grazzi

model-releasesr-localllama
22 Sept 2026
Local Ai

What are normie reactions to your local AI use like?

DGX agent

There's quite a lot of public anti-AI sentiment at the moment, but a lot of the most common concerns and objections have to do with the politics, economics and ethics of datacenter-based AI. So, when

local-air-localllama
22 Sept 2026
Model Releases

What underrated AI tools have actually made you more productive in 2026?

DGX agent

I asked this back in 2025, but the AI landscape has changed a lot since then. Not looking for the usual ChatGPT, Claude, Gemini, Midjourney, etc. I'm curious about the lesser-known tools that you actu

model-releasesr-localllama
22 Sept 2026
Model Releases

XiaomiMiMo/MiMo-V2.6-Distill-Qwen-9B

DGX agent

https://preview.redd.it/ybwqqbrst0rh1.png?width=811&format=png&auto=webp&s=1e40c5b53e304caf2a10efa2baa6f998b9a9a0bb MiMo-V2.6-Distill-Qwen-9B is a 9B agentic model developed by Xiaomi MiMo through sup

model-releasesr-localllama
22 Sept 2026
Model Releases

16GB (and in many cases 12GB) is the max vram most people will ever reasonably have

DGX agent

This sub is, needless to say very niche and skewed towards the high end. There are tons of extremely high end setups here with multiple gpu's etc. Even 24GB is out of reach of most people financially,

model-releasesr-localllama
21 Sept 2026
Model Releases

2x r9700 in one strix halo machine

DGX agent

https://preview.redd.it/5aon65uosrqh1.jpg?width=1000&format=pjpg&auto=webp&s=cd21ce0648b0ffa5dc07e66718a230f1f91d8a53 I have a GMKtec EVO-X2, it doesn't have oculink nor pcie slots, but it does have 2

model-releasesr-localllama
21 Sept 2026
Model Releases

50+ Hours and 100M+ Tokens Later, Open Source Autonomous Agent is GETTING CLOSER at Solving an Open Math problem

DGX agent

This experiment is live, you can inspect all the internal reasoning, memories, attempts here: https://artificium-covering-experiment.gr.bio/ The problem that the agent is trying to solve is a covering

model-releasesr-localllama
21 Sept 2026
Model Releases

A better coder for the small-GPU/small-RAM crowd!

DGX agent

I’ve been working on making small models more capable at agentic coding and work, because most people in the world don’t have the sort of hardware needed to run 3.8-27B, or even 35B-A3B or 9B dense, a

model-releasesr-localllama
21 Sept 2026
Model Releases

Can a relatively small language model (Qwen 3.8 27B) understand visual style and not just describe it?I asked it to recreate 618 visual language of designers, artists, movements etc and then transfer those ideas into entirely new SVG artworks and pages. Here what we have:

DGX agent

I decided to do this experiment to see what would be the ability of an LLM model to, in a single shot, transfer the knowledge it may or may not have about that artist/brand/designer/animator to a comp

model-releasesr-localllama
21 Sept 2026
Model Releases

convaiinnovations/laya (multilingual, non-autoregressive System 1 decision model)

DGX agent

Laya is an open-weight (Apache 2.0) 'System 1' decision model from Convai Innovations, built by Nandakishor M as an open alternative to TypeSafe's closed Jev API. Instead of generating text, it takes

model-releasesr-localllama
21 Sept 2026
Model Releases

Deepseek training 2T and plans 8T model

DGX agent

Quote: DeepSeek is training a 2T-parameter model and plans to eventually build an 8T-parameter model. https://x.com/wallstengine/status/2101982843656388644 Current DeepSeek models: Flash parameter cou

model-releasesr-localllama
21 Sept 2026
Model Releases

Deterministic Kittens: fun with Qwen Image 2.1 on an M2 Macbook Pro

DGX agent

Having a blast with Qwen Image 2.1 on my M2 Macbook Pro with 32GB RAM, even though it takes 16 minutes to complete the recommended number of iterations with the resolution reduced to 1024x1024. And th

model-releasesr-localllama
21 Sept 2026
Model Releases

Gewell - Gemma4 inference engine

DGX agent

# the What An engine to run Gemma 4 31B on blackwell under massive concurrency and rather specific workload patterns. I've been waiting for someone to do ninfer but for gemma, and, well, ended up havi

model-releasesr-localllama
21 Sept 2026
Model Releases

Got jev-like api running natively on ninfer / qwen3.8 27b and results are quite decent

DGX agent

Hi all! After all the jev hype I wanted to try by myself and got qwen3.8 27b to mix-and-match open implementations on top of ninfer, and to be honest I'm quite impressed with the results, latency is n

model-releasesr-localllama
21 Sept 2026
Model Releases

Has anyone tried ingesting 1k-100k scientific papers into LLM wiki?

DGX agent

I want to try using AI to find possibly overlooked interventions for irritable bowel syndrome (IBS) and create a cocktail of interventions that AI thinks would give the highest expected benefit, attac

model-releasesr-localllama
21 Sept 2026
Model Releases

hearim(헤아림): Maybe you don’t need a special model for Jev — ordinary local LLMs already have the capability

DGX agent

What if you don’t need a new model to get Jev-style decisions? I built hearim(헤아림. hea-a-rim. not Here, I am.. lol), an open-source gateway that turns ordinary local or hosted LLMs into a Jev-compatib

model-releasesr-localllama
21 Sept 2026
Local Ai

Hemmingway-1: An AI that writes like a person (Qwen3.8-27B finetune)

DGX agent

https://preview.redd.it/d7brwofkhuqh1.png?width=1400&format=png&auto=webp&s=9a0079ebc2710faff9a73378dac58c6dd67e3cec link: https://huggingface.co/Altworld/Hemmingway-1 submitted by /u/paf1138 [link] [

local-air-localllama
21 Sept 2026
Model Releases

[MASSIVE RELEASE] Supra2-IMG - a tiny 100M text-to-image model - SOTA quality and open release!

DGX agent

Hey everyone! It has been quite a while since the last SupraLabs model - but today we've something special for y'all: Supra2-IMG It's a 100M parameter DiT text-to-image model trained entirely from scr

model-releasesr-localllama
21 Sept 2026
Model Releases

Mimo v2.6-Flash-RL vs open-weight models

DGX agent

Since there’s no comparison chart on the model page, I asked Perplexity to compare it against some relatively small open-weight models in a similar size range. Here are the results. Upd. Terminal-Benc

model-releasesr-localllama
21 Sept 2026
Model Releases

mini-AGI - dynamically grown (530M params currently and growing) continual learning model trained from scratch on 8GB VRAM laptop from batch-1 stream of data.

DGX agent

Sorry for the pretentious name, I know, I know.. It just contains all the pieces I would like to see a AGI model to have, and I can't stand the temptation. Before throwing rocks at me, please take a g

model-releasesr-localllama
21 Sept 2026
Model Releases

Putting the question before the context took my local Qwen from 89% to 100% on a decision benchmark, and from ~400 ms to ~80 ms

DGX agent

Small, free finding. I use local Qwen models for typed decisions: a state plus a question with fixed allowed answers, and I read the probability of each answer from the logits of one forward pass inst

model-releasesr-localllama
21 Sept 2026
Model Releases

[Splash Engine] Qwen3.8-27B in native 8-bit at 37–55 tok/s on Apple Silicon: Extending Splash to Q8, 256k context scaling, and the 'Reasoning Cliff'

DGX agent

https://preview.redd.it/nulsv53o8vqh1.png?width=4500&format=png&auto=webp&s=74765dbd409f4c221640f9f6000a685f6fdbb242 Spent weekend benchmarking the Splash engine (by Incoai) and extending its architec

model-releasesr-localllama
21 Sept 2026
Local Ai

Uncensor an LLM without touching weights: inject a tiny trained KV-cache bank (~18MB) and unload it anytime

DGX agent

I shipped something I've been building for the last few weeks : phantom-kv , a refusal-removal system for large language models that doesn't touch a single weight. Instead of editing the model, it loa

local-air-localllama
21 Sept 2026
Model Releases

Where are the current GPU VRAM sweet spots?

DGX agent

I have been reasonably satisfied with my single R9700 (32GB) as I can run practical quants of Qwen 3.8-27B at good speeds, as well as other similar models in its weight class (Gemma 4 is still my go-t

model-releasesr-localllama
21 Sept 2026
Model Releases

yandex/AliceAI-Foundation-80B-A3B-Base: Russian-developed competitor to Qwen 35B and DeepSeek V4 Flash

DGX agent

https://huggingface.co/yandex/AliceAI-Foundation-80B-A3B-Base It's not a Qwen3 finetune, it's actually its own fully custom architecture. No Llama.cpp support yet sadly (Also note that this model is N

model-releasesr-localllama
21 Sept 2026
Model Releases

You can use any LLM just like JEV

DGX agent

You can simply run any GGUF with llama.cpp with n_predict=1 and n_probs=10, disable reasoning, and prompt it such as 'If the following email is spam, respond with 1, if not spam, respond with 0. Do no

model-releasesr-localllama
21 Sept 2026
Model Releases

ZCode is now open source

DGX agent

ZCode is now open source, and the reported security issues have been addressed. Source code: https://github.com/zai-org/ZCode The repo includes its desktop app, web workspace, backend, Agent CLI, and

model-releasesr-localllama
21 Sept 2026
Model Releases

A Jev-style model fine-tuned on Qwen3.5 4B

DGX agent

This weekend, I did a fun experiment to create something similar to Jev. I LoRA fine-tuned Qwen3.5 4B using a mix of publicly available datasets and synthetic data. For the synthetic data, I used Deep

model-releasesr-localllama
20 Sept 2026
Model Releases

a local Jev-style decision head onto Qwen 2.5 1.5B

DGX agent

Jev from TypeSafe AI got me thinking about non-autoregressive decision engines, so I built a small proof-of-concept called AES to test the concept locally on open weights. It uses Qwen/Qwen2.5-1.5B-In

model-releasesr-localllama
20 Sept 2026
Model Releases

DIY Jev

DGX agent

So this jev thingy is getting kind of big... tbh it seems overhyped by a large margin, but here we are. Not that its bad, just feels like we usually ignored larger things... Anyway to the point of thi

model-releasesr-localllama
20 Sept 2026
Local Ai

Do NOT trust StepFun's Plan subscriptions., They stole >$100 from me with no warning, and I have not heard back from support at all.

DGX agent

I know cloud subscription plans are not exactly the core focus of r/LocalLLaMA, so I want to be clear about why I’m posting this here. I’ve been building my own local text-based RPG/game harness and u

local-air-localllama
20 Sept 2026
Model Releases

Finally got Qwen 3.8 Next running on my v100 6gpu setup (TP2 PP3)

DGX agent

Hey everyone, After wrestling with hardware and engine issues for days, I finally got Qwen 3.8 Next running properly on my multi-GPU rig. Thought I’d share the setup journey, benchmarks, and thermal r

model-releasesr-localllama
20 Sept 2026
Model Releases

focus-llama: a llama.cpp fork implementing Declarative Attention (arXiv:2609.02737)

DGX agent

I forked llama.cpp to implement Declarative Attention (arXiv:2609.02737, Google DeepMind and KAIST AI). The model declares in its own output which context chunks it needs <focus magic_chunks='N'>), an

model-releasesr-localllama
20 Sept 2026
Model Releases

gemma 4 ran a shell command a web page told it to. qwen 3.8 mostly didn't.

DGX agent

i have been running local models as browser agents on an m5 macbook pro, 128gb, all through mlx, no cloud. first i just wanted to know which one was faster at real browser work, so i gave gemma 4 31b

model-releasesr-localllama
20 Sept 2026
Local Ai

I gave Jev, Laya, finetuned ModernCE and Qwen3.5 the controls to Doom

DGX agent

I gave Jev, Laya, a finetuned ModernCE-base-nli and a finetuned Qwen3.5-4B the controls to Doom. Thanks to TypeSafe AI for Jev access. The video lines up the starts of four separate games with the sam

local-air-localllama
20 Sept 2026
Model Releases

I tested 9 LLMs on the exact same web-dev prompt for ~8 hours — RTX 3060 12GB results (Rate the best!)

DGX agent

I’ve spent basically the last 8 hours testing different models on the exact same web-development prompt, and I finally finished. The whole point of this nine-hour test was that which local model match

model-releasesr-localllama
20 Sept 2026
Model Releases

Is Typesafe based/derived from work done by the Laya author?

DGX agent

Typesafe's new model, Jev is all over the internet, this sub etc as a new classifier model. Then an AI dev posted here how they'd done something very similar, and made a new model, Laya. https://www.r

model-releasesr-localllama
20 Sept 2026
Local Ai

laya.cpp: Optimized laya near-instant decision making

DGX agent

After seeing u/Nandakishor_ml’s post introducing Laya, I wanted to see how fast it could run in a standalone C++ implementation. Credit to u/Nandakishor_ml for the architecture, training and open-sour

local-air-localllama
20 Sept 2026
Model Releases

Need help fixing Gemma 4 26B A4B toolcalls in Pi

DGX agent

Hello! So, yesterday i tried out Gemma 4 26B A4B QAT Q4_K_XL from here with Q4_0 MTP model in Pi agent. Suddenly, it became the first model to actually pass my simple test with HTTP server in C++, whi

model-releasesr-localllama
20 Sept 2026
Model Releases

PromptDeck v1.1.0 – open-source desktop app to benchmark local AND cloud LLMs side-by-side (Ollama, LM Studio + OpenRouter, Groq, DeepSeek…)

DGX agent

Hey r/LocalLLaMA! I just released PromptDeck v1.1.0 and wanted to share it here since this community is basically the reason it exists. What it is: an open-source desktop studio (Tauri + React) for pr

model-releasesr-localllama
20 Sept 2026
Model Releases

Qwen-Image-2.1 released!

DGX agent

Meet Qwen-Image-2.1, the most balanced and cost-effective image generation model in the Qwen-Image series! Now open weights! 🎨 A unified model for both generation and editing, delivering top-tier qual

model-releasesr-localllama
20 Sept 2026
← Previous
1…910111213…38
Next →