AI Wiki — Knowledge Base

I turned Qwen3.8-27B Q2_64 + llama.cpp into a fully TypeSafe AI-compatible Jev-like system. OpenAI API still intact! World’s first Vision-enabled Jev-like model! <10 GB VRAM, 170 ms on an RTX 3090 and ~140 tok/s in chat. 76% vs. 88% Jev-1.13 Acc. on a diverse 22,000-request typed-decision benchmark

Yesterday I released Bonsai-Llama-Jev - a Jev-like Typed Decision inference system for locally operated, sovereign AI. In my new typed-decision-bench, covering more than 22,000 decisions across 175 us

model-releasesr-localllama

23 Sept 2026

Search: “benchmark”

A collection of small domain-specific benchmarks for local models (30+ and growing)

35B-A3B tool calling benchmark: Original Qwen vs. KAT Coder, Ornith and Tiel-Coder

Just another purely open-weight models benchmark

Lit Review on Benchmarking LLMs Running in your phone!: MobileWorld: Benchmarking Autonomous Mobile Agents in Agent-User Interactive and MCP-Augmented Environments

I benchmarked IFM/K2-Horizon-7B on 16GB VRAM

Measuring LLM performance drift: observations and methodology from 31,352 repeated benchmark measurements [D]

I built an LLM benchmark harness that lets you browse and compare how models answered each question

I benchmarked Qwen 3.8 27B on my M4 Max — here's what I learned about local models, context, and coding performance

New benchmark on LMs fixing bugs before users run into them

Made the horizontal open-source model for Jev with RLCD, and it surpasses all the Jev benchmarks. HF space, benchmark, model, repo

Why are almost all new benchmarks and leaderboards coding focused?

Planning to spend ~$100 benchmarking differnet Qwen3.8-27B quants and kv cache and looking for input before I start

I made my own cybersecurity benchmark and ran Qwen3.8 27B, here's how a local model actually does at hacking

DeepSeek V4.1 Flash beats Astra on AA's new benchmark

we benchmark models nobody actually runs

Anyone interested in building a harness-only benchmark?

Deepseek V4 Flash 2-bit quant is the first model I can run locally that achieves 100% in this SQL benchmark

Dual Radeon MI50 benchmarks

Coding benchmarks that are quickly showcasing deep capability

I benchmarked 9 open models on spotting fake sources during agentic search (DeepSeek V4, Qwen 3.8, Nemotron 3 Ultra)

Qwen3.8-Flash-Next (UD-IQ4_XS) on 2x RTX 3060 + 7800X3D, from initial 36 tps prefill to 400 tps and other benchmarks (-sm tensor trap) + VRAM/RAM usage

Optimizing Qwen3.6 / Qwen3.8-27B on 16GB VRAM: Complete Benchmark Results and Setup Guide (~30-50tps at 32k to 72k context)

any reasonably fast public benchmarks I should run quants of deepseek flash 0731 on?

KV cache quantization benchmarks: 413 pairs tested on Qwen 3.6 27B, Gemma 4 31B. KLD with BeeLlama.cpp v0.4.0: KVarN 6-bit beats q8_0, precision tail 1024 dominates

DeepSeek v4 Flash vs. Qwen3.6-27B, 3.5-122B, and Gemma 4 31B Benchmark

What’s the community’s favorite benchmark to validate performance?

I built a desktop benchmark for local Ollama models — TTFT, tok/s, VRAM, with a HuggingFace GGUF catalogue

QontoFAQ: A better Information Retrieval Benchmark [R]

Where are you running DeepSeek V4.1 Flash reliably? I can't get it to finish a single 2-hour benchmark run

Radeon RX 7900 GRE 16GB and RX 480 8GB Vulkan benchmarks llama.cpp

I collected every single LLM coding benchmark, and computed their Intelligence Density

Which LLM is actually best at pentesting? benchmark to find out

Artificial Analysis 'Intelligence': A meaningless benchmark

New/Old benchmark that provides a lot of answers for local LLM

Gemma 4 QAT handles KV cache quantization MUCH better, KLD benchmarks show

DSpark Benchmark Result on Deepseek v4 Flash 0731

Two 96 GB Ascend cards crun Qwen3.8-flash-next hardware notes, vLLM work, benchmarks, and what is next

Trained locally: ultra-fast 0.8B/2B System 1 decision models that match Jev on benchmarks and Doom, ~30 ms per decision (open weights)

Putting the question before the context took my local Qwen from 89% to 100% on a decision benchmark, and from ~400 ms to ~80 ms

PromptDeck v1.1.0 – open-source desktop app to benchmark local AND cloud LLMs side-by-side (Ollama, LM Studio + OpenRouter, Groq, DeepSeek…)

Forget the Pelican, it's Weevil-Time! / Benchmaxxing-Proof SVG and Vision Benchmark

BeeLlama.cpp v0.4.1: KVarN, KV precision tail, q2_0-q3_1 KV cache, improved support. KLD benchmarks: tail 1024 makes kvarn5 and q6_0 match q8_0, for much less VRAM

Benchmarking programs?

Qwen 3.8 Flash Next Q3 S - Benchmark creation

GPU - Vulkan llama.cpp benchmarks sorted by price to performance

We benchmarked 24 LLMs against human writers on 475 creative writing prompts

Cut Qwen3.8-27B Reasoning Tokens by 40% -- 3.8 'ThinkingCap' benchmarked!