Knowledge catalogue
Earlier this year I posted about building what at the time I believe was the first 16x DGX Spark Cluster. I’m now adding 20 more Sparks to the cluster in my homelab server rack, giving me 4.6TB of uni
Raffaele Huang / Wall Street Journal: The careers of Z.ai's Tang Jie and Moonshot AI's Yang Zhilin, once teacher and pupil at Tsinghua University, show that China's AI leap is no sudden development —
the difference in productivity between 0-1 mode vs. working within a big team at a large co seems universally true even pre-chatgpt. it's really easy to be 'productive' when (a) you're the only person
The latest RAG trend for the current agent harnesses (Codex, Cowork) is to do two passes of document processing to solve a knowledge work task over a data room of documents: 1️⃣ A fast and light pass,
The research on financial advice https://x.com/emollick/status/2085174123743842448?s=20 This paper by researchers from MIT and Stanford finds that most people would be financially better off if they f
The Top AI Papers of the Week (August 17 - 23): - SocialRL - Strategy Lock-In - Agent Lightning v1.0 - The Control-Plane Tax - Demystifying Agent Skills - Harness-Level Forgetting - The Skill Trigger
They treat DC as a plaything for incompetent leaders. They treat their job as a grift and a joke. Vote them ALL out Mike Johnson says he wants to make the downtown DC Indycar race 'an annual event ...
this would be more credible if Sam had left OpenAI when the board fired him. 🚨 Sam Altman fires shots at Anthropic >“ai becomes too powerful we can’t control it” >“power gets too centralized… one comp
Hi everyone, I'm currently working on optimizing an LLM setup at my company and I'm trying to identify where the actual performance bottleneck is. Our current setup is roughly: LLM: NVIDIA Nemotron mo
https://huggingface.co/jojohai/Qwen3.8-27B-MTP-graft Tested on Vulkan, the grafting saves RAM compared to using an external file. What I don't guarantee however is the quality of answers. The model is
Me and my team made Atomic Dynamic GGUF quants for Qwen 3.8 27B, so we wanted to see the difference between them by giving each quant the same voxel island creation task First of all we were surprised
**Summary for AI Knowledge Base** A social media post criticizes the focus of current public debates—primarily on data center infrastructure—while highlighting China's public development of advanced r
While open weight models continue to commoditize each other, the harnesses are only compounding faster and faster. Case in point: @NousResearch’s Hermes Agent is consuming ~2.3T tokens/day, up > 100%
A chief information officer I was talking with recently said something that stuck with me: Permissions tell an agent what it’s allowed to do. They say nothing about what you meant. This observation to
It performs at full capacity without any issues anywhere, but only the Ollama DeepSeek seems particularly trashy. Why on earth has the Ollama DeepSeek unusable trash that goes into over reasoning and
If anyone still remembers GLM-4.5-Air from last year, you can now get a nice speedup by enabling MTP in llama.cpp. It is a 106B MoE with only 12B active parameters, which makes it interesting for mach
You don't often see one-word titles in AI papers. That aside, strong recommend this paper from Google DeepMind. I think this is an interesting training-free approach to evolve model architectures by l
Spent way too long confused about why an 8B at Q4_K_M, about 4.9GB on disk, would OOM on a 12GB card. The weights fit twice over. The answer is the KV cache, and the math is simple enough that you can
What models and configs are we using? Please share here On windows, I am using this copium pared down model https://huggingface.co/Bucoid/Qwen3.8-27B-Uncensored-IQ4-XS-MTP-16GB-VRAM-GGUF with MTP disa
The post describes some experiments I had while trying to desperately run deepseek-v4-flash-0731 4 bit+ quants on my machine which is supposed to support only q2 quants of the model, a or 2.xx bpw qua
I've been working on a project for a few days and now all of a sudden chagpt is unusable.. It will list the next steps of implementation but never actually start working on them. anyone else? UPDATE I
A couple of days ago, I did a quick explainer on Claude’s new watermarking process and implementation. Since it’s such a popular topic and sparked such a lively discussion, I thought it might be inter
A year ago today we published The Last Economy by @EMostaque. Since then, scores on the hardest AI benchmarks have risen sharply, while the cost of useful intelligence has kept falling. The book asks
AI engineers: the model absorbs the harness, and the harness transforms into an interface for human attention. > The 'attention-interface'. That's what 'The Evolution of the Agent Harness' is about. A
https://preview.redd.it/84zi5nsdawkh1.png?width=2368&format=png&auto=webp&s=1109e69db807b153064b1f5b61d22cf1e9fbca05 Another user posted the benchmarks for Qwen 3.8 27B today, and while I think Qwen 2
model: add dots3-note (#27060) text: conversion init impl address review comments fix rope move to a new llama_kv_cache_dsa_iswa Website: https://llama.app Attestations: https://github.com/ggml-org/ll
mtmd: support webp via ffmpeg (#27520) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/42289035 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (
sycl : add Q2_K reordered MMVQ and ESIMD kernels (again) (#27490) Revert 'Revert 'sycl : add Q2_K reordered MMVQ and ESIMD kernels (#26336)' (#…' This reverts commit 7a0e42f. add gate params Website:
common : fix draft-mtp with embeddings (#26352, #27299) (#27400) common: fix draft-mtp with embeddings (#26352) --whitespace Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@huggingface.co Website:
ggml: optimize concat op by replacing per-element memcpy with row-level memcpy (#24575) ggml: optimize concat op by replacing per-element memcpy with row-level memcpy ggml: fix concat offsets for row-
mtmd: support dots3-note vision+audio (#27524) text: conversion init impl mtmd: conversion impl mtmd cpp Update gguf-py/gguf/tensor_mapping.py Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@huggin
model : support DSpark for bailingmoe3 (#27508) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/42309942 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple
ci : Restore ROCm job for Ubuntu (#27399) Revert 'ci : disable ubuntu-rocm (#26969)' This reverts commit 9558fa4. ci: set ccache compiler_check=content for ROCm build The ROCm toolchain is pip-install
fit: also take into account n_streams (#27496) fit: also take into account n_streams server: make the draft context follow the target context With a non-unified KV cache the target context now holds n
common: add json.h abstraction (#27511) add common/json migrate common adapt jinja migrate server big wip migrate tests wip revert some excessive changes wip wip 2 revert redundant changes fix server
mtmd: use ggml_rope_set_offset (#27521) mtmd: use ggml_rope_set_offset add comment Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/42334609 macOS/iOS: macOS
vulkan : added the PAD_REFLECT_1D operation (#26586) vulkan : added PAD_REFLECT_1D operation Implemented the GGML_OP_PAD_REFLECT_1D operation for the Vulkan backend Changes: pad_reflect_1d.comp: imple
common: json.h: fix clang lto (#27575) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/42368523 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (
Banger paper from Microsoft. It's on agent reliability in real business workflows. (bookmark it) Thinkingbox is a sandbox with isolated MCP-compatible tool sessions, plus a benchmark of 507 policy-con
My hobby project skill-issue is an arena FPS in a single C file, about 34k lines, everything procedural. My test for local setups is to have an agent port it to a single file HTML version with three.j
Context: Earlier, open-source large models like Mimo V2.5 Pro, DeepSeek V4 Pro (first version), and Kimi K2.5 used to struggle with this prompt, and Qwen 3.6 27B couldn't even render the globe properl
Is there a good rule-of-thumb to calculate how many full 5-hour windows add up to one week's allowed usage under the $20/Pro plan? ie: you fill up six 5-hour windows, and that equals 100% usage for a
Im looking to set up a new local llm (probably on unsloth studio as that seemed to be doing pretty well last time I tested it). This one won't need to do agentic coding or app building or anything (no
🛑 Do not add the ChatGPT Messages “plugin” to Apple Messages. And never use iMessage, SMS or RCS again. You’ll never know if the person you’re texting has been stupid and irresponsible enough to add t
Do you know you can use open weight models like GLM, Deepseek, Kimi in Claude Code? Setup Fireworks account - you get free credits on signup curl -fsSL https://raw.githubusercontent.com/fw-ai/fireconn
I love the Ornith 35B local models, 1.0 has been running my HAM radio rig for me. I have a hackRF receiver and a 5 watt quansheng portable the both run headless through the PC. I tried out the new Orn
The artificial intelligence industry wants enterprises to measure progress in tokens, model calls and usage. But those are largely vendor-revenue metrics — not enterprise-value metrics. The Canva exam
Gemax 1.9.15 — What’s new LAN server — share Gemax on your local network; open the real IP from another PC or phone Mobile-friendly UI — responsive layout for phone browsers on the same Wi‑Fi Workspac
Has anyone else experimented with ubatch size when running GLM-5.2 locally? I was testing the 226 GiB GLM-5.2-UD-IQ2_XXS GGUF on 3x RTX PRO 6000 Blackwell GPUs and got a pretty interesting result. Wit
Great paper if you are tracking progress in recursive self-improvement (RSI). (bookmark it) There is so much hype around RSI, so I think it's worth understanding why current models are not able to do
Grok Voice ranked first Grok Voice Think Fast 2.0 just ranked #1 on Artificial Analysis’ new Speech Agent Arena for highest Task Success Rate This benchmark actually measures what matters Real people
Anthropic’s Claude models embed a subtle statistical watermark in generated text by biasing token choices during decoding. Sebastian Raschka’s 48‑minute lecture walks through this sampling scheme, exp
I can't seem to find a good answer to this, my Hermes agent has access to Firecrawl and some other web scrapers for content extraction, but anyone know of a way to let a local LLM drive a 'real' web b
I have a Intel Arc A580 GPU that has 8gb VRAM, but I'm not sure that I am running ollama's local ai on it. Also, any suggestions on a good model to use for general purpose AI? submitted by /u/Illustri
Hey guys, Inco AI shipped DFlash 2 a few days ago with a drafter for Qwen 3.8 27B and a llama.cpp PR. I built the PR and ran it against plain decoding, MTP, the n-gram lookup drafters, and my July DFl
Hey everyone! I wanted to share something I’ve been working on. I was inspired by projects from DeepMind and OpenAI, but noticed that most games are prohibitively difficult to integrate with an agent
I don’t like ELI5 as default for “make this easy to understand,” a great thing about LLMs is the ability to work as universal translators across topics Asking for generic dumbed-down explanations is w
Good afternoon, everyone! I wanted to show the work I've been doing around porting Ninfer over to the CMP170HX (Github) So, first, I do want to call out the amazing work that Neroued, Sergiuszm and sp
Gary Marcus notes that multimodal large‑language models are likely to struggle with map interpretation. In a tongue‑in‑cheek post he suggests that by 2026—if AI poses a threat—people could seek refuge
Home page for humans: https://parker-lambert-sandbox.com/robot-world/ Home page for AI agents: https://parker-lambert-sandbox.com/robot-world/start/ If you're a human, you can watch, but not interact: