AI Wiki — Knowledge Base

CrofAI 'cheapest inference provider in the world' gets exposed as an OpenRouter wrapper, routing requests to smaller, cheaper models at up to 20x markup. CrofAI responds to Wire Fraud allegations by denying everything, then backtracking, then 3 hours later wiping their entire online presence

Disclaimer: no AI was used whatsoever to write this post Cautionary tale about chasing cheap tokens. exposé: https://kendell.dev/blog/crofaifalse/ reaction by nahcrof, announcing the shutdown of the s

model-releasesr-localllama

15 Sept 2026

Search: “engineering”

Two 96 GB Ascend cards crun Qwen3.8-flash-next hardware notes, vLLM work, benchmarks, and what is next

Built a free, open-source Mac native swift AI agent Harness with actually usable computer use because we shouldn't need outrageous paid plans.

Update: Strix Halo + R9700 with llama-halo-hybrid - now beats DGX Spark

50B+ MoEs with few active parameters, what's the sweet spot for intelligence, agent speed, and affordable fine-tuning?

Thanks to you r/LocalLLaMA, my mom was able to use my app! The open-source app that can watch your screen and trigger actions. It is now easy to use, thanks to your feedback.

Can someone explain how a LLM goes rogue.

Swift 1.5 + HyperQwen = 37% less task completion time at 100+ tps w/ 150k context on RTX 3090

Advice on models for RAG use case

Power Limits, Local AI, and Questionable Uses of My Free Time

85 GB DeepSeek-V4-Flash at ~3 tok/s on a 12 GB RTX 3060 + 64 GB DDR5 RAM - Overspill for FreeToken, inspired by Colibri

Meet Observer, an agent that uses local LLMs to monitor your screen, so you don't have to

PSA for M5Ultra owners running LLMs: set your prefill step to 8192

JEV almost dead: CLM vs JEV

R9V Update: Created and adopted KVA projections based on Deepseek V4.1 Flash + HySparse2/MiMo-V3 for Qwen3.8 Flash Next. This is a game changer for models that don't natively implement it. 1.45-1.85x speedup in prefill to 3k+ at a small deficit to perplexity. [2x R9700, 128GB DDR5]

Graphic producing new model Ming works fine in Comfy

GUI harness [video]

Fork of FreeToken with DeepSeek-V4.1, vision and speculative decoding (2x3090 numbers inside)

Got jev-like api running natively on ninfer / qwen3.8 27b and results are quite decent

The Digital Mind

Built a home server from an old PC with GPU upgrade. Qwen3.8 27B runs at ~30 tokens per second.

Finally got qwen 3.8 q4 k_M 27b runnin slick 40tkps load at 240k inf 4qnl for stable agentic coding on a 7900xtx. I have been finally able to give hermes a task and come back to results. Built a panel to manage my inference servers from hermes.

Tuning Qwen 3.8 27B and OMP as a coding agent on 2× 3090s

bonsai's document reveal how much cherry picked their headlines are

Technical Feedback: GLM-5.1 Retirement — Significant Regression in Agentic Workloads

XingChen-AGI/Xing4.0-29B-A4B MoE

Qwen3.8-27B uncensored Q6_K at 156K context on one RTX 5090, 140-190 tok/s with DFlash2

Write up on building and improving reliability of agentic harnesses + a big dataset from my work.

CrofAI 'cheapest inference provider in the world' gets exposed as an OpenRouter wrapper, routing requests to smaller, cheaper models at up to 20x markup. CrofAI responds to Wire Fraud allegations by denying everything, then backtracking, then 3 hours later wiping their entire online presence

Cut Qwen3.8-27B Reasoning Tokens by 40% -- 3.8 'ThinkingCap' benchmarked!

I trained a 44M parameter quantized LLM from scratch on 45B tokens. It ships in 19.8 MB and runs at ~1,900 tok/s on CPU. [P]

R9V Update: now ~100 tok/s in TG on Qwen3.8 Flash Next IQ4_XS on x2 R9700 + 128GB RAM. Fixed crashes with n-gram SSD streaming, improved diagnostics, plus pinned images. Q4_K_XL now supported, 50 tok/s TG.

Dear 24G owners, try VLLM you might be able to run Qwen3.8 27B INT4, 144K FP8 KV on RTX 3090 with better speed. (TLDR VLLM AOT)

Horse racing as an ML ranking problem: 1.18M runners, walk-forward validation and a very strong market baseline [D]

My experience building 64GB VRAM AI SWE assistant/agent PC

Qwen3.8 flash next - untrained svg generation

Style transfer capabilities of different open-source methods 2026 Update

I am impressed and I owe you one, Qwen 3.8 flash next (vision)!

Any 12gb VRAM users out there?

Local LLM / Qwen 3.8 win

The CEA architecture is a bigger deal than I initially thought

What settings do you use for running Qwen3.8-Flash-Next in llama.cpp?

How many agents can 2×4090 actually run at once? Three weeks of llama.cpp concurrency data — soft cap 5 @ 64k, hard cap 9, and why.

After over a year of my nights and weekends, the Jenny app is done!

ExLlamaV3 is underrated

I made Warrior Quest, a local LLM-powered dark-fantasy RPG where the model only plays NPCs and the actual game state stays deterministic

My Qwen3.8-27B task-aware quant reaches 99% of BF16 reasoning performance at 15% of the size.

48 tg/s 440 prefill on my grandma's cluster (2xP40) (sort of)

Coding benchmarks that are quickly showcasing deep capability