AI Wiki — Knowledge Base

I turned Qwen3.8-27B Q2_64 + llama.cpp into a fully TypeSafe AI-compatible Jev-like system. OpenAI API still intact! World’s first Vision-enabled Jev-like model! <10 GB VRAM, 170 ms on an RTX 3090 and ~140 tok/s in chat. 76% vs. 88% Jev-1.13 Acc. on a diverse 22,000-request typed-decision benchmark

Yesterday I released Bonsai-Llama-Jev - a Jev-like Typed Decision inference system for locally operated, sovereign AI. In my new typed-decision-bench, covering more than 22,000 decisions across 175 us

model-releasesr-localllama

23 Sept 2026

Search: “research”

CyberKimi just dropped strong results on one of ExploitBench’s hardest V8 bugs , points away from Mythos

KLQ: Training-free measured rotation quantization. Beats all training-free rotation-based quantization methods on W4A4KV4-bits. Llama 3.2 1B KLQ-quantized beats SpinQuant and gets close to ReSpinQuant without GPTQ/LDLQ rounding.

Quick survey (2 min) on trust in hardware specs for open-source models

How do you test your setup?

Experience sharing: How do you use your local models and for what kind of tasks?

Open Source Ternary LLM Engine in Rust/CUDA for Quantization, Serving, and Training of models on consumer GPUs, called Tritium (Apache 2.0)

How do you use AI in your work? (Dissertation)

CEO of Hugging Face: 'In the spirit of transparency, here’s what I asked OpenAI'

DeepSeek Founder’s 4-hour investor meeting: DeepSeek is prioritizing AGI over user growth and commercialisation

I run GLM-4.5-Air (110B) on 16Gb ram consumer machine and Qwen3-30B at 20 tok/s

I trained a 0.5M model on 1B tokens of Fineweb-edu dataset.

RL post-training on 14 Macs across 4 countries

I released a softmax-free attention model at GPT-2 Medium scale (~354M params, 11.5B tokens): structural sparsity + tile-skipping kernels for long-context VRAM savings. Open weights + custom Triton kernels [R]

Was BitNet a dead end? What happened to ternary LLMs?

I have distilled my flow matching model into the rectified flow model, so it can now generate in few steps and without cfg.

Need advice on building/training an AI Agent for fully automated blog generation

GPT-5.5 dominates $1,500 LLM hacking test while Gemini refuses to even try

Scientists invented a fake disease. AI told people it was real

'This is the first documented instance of AI self-replication via hacking.' ... 'We ran an experiment with a single prompt: hack a machine and copy yourself. The AI broke in and copied itself onto a new computer. The copy then did this again, and kept on copying, forming a chain.'

GPU Compass – open-source, real-time GPU pricing across 20+ clouds [P]

Built an political benchmark for LLMs. KIMI K2 can't answer about Taiwan (Obviously). GPT-5.3 refuses 100% of questions when given an opt-out. [P]

34.8% of employee AI inputs now contain sensitive data

Lyra 2.0 : Explorable Generative 3D Worlds

Gen Z workers are so fearful AI will take their job they’re intentionally sabotaging their company’s AI rollout

How 10 years can change things. This is OpenAI.com in 2015.

'New AI fake text generator may be too dangerous to release, say creators' (2019 Guardian headline)

Local Qwen 3.8 27B vs DeepSeek Flash API: Is local good enough?

Qwen 3.6 35B and indentation

Tested in Coding: Strata

Where to get started if you want to publish papers in Neurips,ACL,ICLR/A* conferences [R]

Y'all this is a sexy paper; context language models

I used ChatGPT to make my 100-year-old family photos look modern. I wasn't expecting it to change how I see them.

Are there machine learning subfields that are becoming irrelevant (or is irrelevant)? [D]

Power Limits, Local AI, and Questionable Uses of My Free Time

Mac Studio M5 Ultra 96GB vs M5 Max 128GB for local LLMs?

VeriLoop E2 is now open on Hugging Face — curious what Ollama/GGUF quantization would make the most sense for this 27B model

50+ Hours and 100M+ Tokens Later, Open Source Autonomous Agent is GETTING CLOSER at Solving an Open Math problem

Uncensor an LLM without touching weights: inject a tiny trained KV-cache bank (~18MB) and unload it anytime

I enjoyed the daily HF papers today

I'm a Principal Applied Scientist at AWS who builds AI services like Amazon Bedrock and Lex. AMA! [D]

Should we get Apple silicon or a 24gb GPU + 128gb ram?

UkisAI Swift-Qwen3.8-27B / -58.3% thinking, x1.95 speed while keeping the accuracy of xhigh

Build around cmp 170hx for qwen flash next

Is there still strong interest in a dense 9b model?

Cybersecurity is local AI model's killer use case

The models are fine, our toolings and methods are shit.

LLM regression in reading comprehension?