AI Wiki — Knowledge Base

I Distilled an LLM into two 287M encoders (GLiNER + multiple choice) for document extraction, can't match teacher. did i do something wrong?

A while ago I asked here how to turn ~5 million court decisions into structured graphs without running an expensive LLM on every document thanks for the advice . I went with the 'small extractor + cla

model-releasesr-localllama

4 Oct 2026

Search: “llm”

I Distilled an LLM into two 287M encoders (GLiNER + multiple choice) for document extraction, can't match teacher. did i do something wrong?

LLM Dictionary: A reference to contemporary LLM vocabulary [P]

I made Warrior Quest, a local LLM-powered dark-fantasy RPG where the model only plays NPCs and the actual game state stays deterministic

LLM-guided program evolution improves 10 best-known circle-packing solutions (Packomania csqv, N=101-114) [R]

Creating windows apps with opencode and a local llm. How do you do it so the llm can use and test what it's doing?

Use Case: Invoice processing with local LLM - Which LLM and hardware requirements?

Bart- A vintage llm [R]

Bart: A vintage llm

llm-server v2 ai-tuning it self now best performance for llama.cpp/ik_llama.cpp (big steps form v1) auto flag optimization

Measuring LLM performance drift: observations and methodology from 31,352 repeated benchmark measurements [D]

A 'free' multi-modal 'embedding' model (already) included with your LLM: vLLM plugin + upstream PR

macOS 27 ships a free local LLM on Apple Silicon Macs. I made it easy to use from Node and Python

One LLM wrote a trading feature. Another reviewed it. Both missed a future-data bug

Trying to optimize LLM inference latency — Ollama + OpenWebUI/AnythingLLM

One of the fastest ways to lose trust in a self-hosted LLM: prompt injection compliance [P]

Running an LLM-driven town with 800+ persistent agents: concurrency, context caching, and inference costs

I asked 4 LLMs to invent words for things only an LLM could understand. Got a dictionary of their own bad habits instead.

mcpstrike – Let your local LLM run the pentest for you

Fixed: IPEX-LLM + modern Ollama models (qwen3, gemma4) on Intel Arc 140V Lunar Lake Windows 11 — undocumented solution

[P] Building a LLM from scratch with Mary Shelley's 'Frankenstein' (on Kaggle)

I trained a 44M parameter quantized LLM from scratch on 45B tokens. It ships in 19.8 MB and runs at ~1,900 tok/s on CPU. [P]

llm performance community metric

My LLM framework. (people asked) (SAI)

[2606.05682] Beyond Output Matching: Preserving Internal Geometry in NVFP4 LLM Distillation

Audio perception layer for LLM agents, with a memory that grows through use

Signals V2: an LLM-free analyzer to scores live agent trajectories as OpenTelemetry spans.

Best value upgrade path from 12GB VRAM RTX4080, 16GB system RAM gaming laptop for local LLM inference?

The LLM tunes its own llama.cpp flags (+54% tok/s on Qwen3.5-27B)

A short horror video I made with Minimax h3, Kroma, Vibevoice and LLM magic

nokia-applied-research/AnyJev: Turn any LLM into a Jev-style decision model

Anyone wonder why americans lag so far behind in the open LLM market?

Best local LLM for real-time PT-BR voice conversation? (Pipeline help)

I built a doctor for local LLM setups: duplicate weights, stale templates, and Ollama silently truncating context

KaozKit: sandboxed LLM agents in JS, fully on-device on Apple Silicon (MLX / Apple Intelligence / Ollama), MIT

I built an LLM benchmark harness that lets you browse and compare how models answered each question

Otaku — an LLM frontend

First local-LLM tuning attempt: Qwen3.8-27B true Q4_K_M at 13.2 tok/s near 50-61K context on RTX 5080 16GB

Looking for a small LLM for Linux command generation

is there a music UPSCALER llm?

New/Old benchmark that provides a lot of answers for local LLM

home lab assistant llm

Best LLM models for invoice data extraction (poor scan quality + handwritten fields)

I trained a 1B-parameter LLM from scratch on 20B tokens for about $200

Needle 2: 14MB agentic LLM for phones, wearables, smart home and robots.

LabyrinthBench: a local-focused, judge-free LLM benchmark that measures context recall under interference for multi-step agentic tasks.

Unexpected use of local llm

Do people building local LLM rigs track RTX Ada/workstation card prices, or just consumer cards like the 5090?

Local-first LLM pipeline tracer — @trace on any function, dashboard at localhost. Feedback welcome.