Knowledge catalogue
Hi, I've been wanting to run my own local LLM for some time and I finally saved enough to get a budget GPU. I can spend 700 at most, and I'm looking for a GPU that can run quantized 30B~ parameter mod
Research acceleration: The view inside OpenAI Apparently today is RSI day at OpenAI, for Recursive Self-Improvement - I think it's their new AGI. Both this piece and the new essay An Alien Mind (by Ch
“The expected value of a fully LLM-generated, non-human-reviewed patch is a net-negative by a considerable margin.” 🦔AI can only fix security vulnerabilities 26% of the time. Researchers at 1Password
Update: BOEING 767 OVERRUNS RUNWAY AT MIAMI INTERNATIONAL AIRPORT A Boeing 767-33 operated by Prime Air has reportedly overrun the runway at Miami International Airport (MIA), Florida. Emergency respo
Hello, I'm a bit obsessed with cache management on local LLMs. For the last few days I've been working on cache management on vLLM with my 2x DGX Spark and DeepSeek v4 Flash 0731. I felt something was
You need Blender 5.x with MCP extension. I use pi so I also need: pi install npm:pi-mcp-adapter and then: $ cat .mcp.json { 'mcpServers': { 'blender': { 'command': '/home/jacek/.local/bin/uvx', 'args'
Hi everyone I'm running four rtx 4090, 64GB ram, on a threadripper pro motherboard so all PCIe x16 ports, as a homelab machine for coding. I was migrating from vllm + qwen 3.8 27B (fp8+256k kv cache)
Hugging face has over 300 versions of qwen3.8-27b. I have no idea how to identify the beat model to download and use. Should I sort by “most likes” or “most downloads”? Is there any sort of other guid
Yet another win for Neurosymbolic AI! Fermat! Anthropic says its first Fermat runs failed not on math, but because dozens of Claude agents lost track of shared project state. They only succeeded after
Another neat one: I had GPT-6 Astra build a model of a famous never-built building, Boullée’s 1784 Centotaph. There were only a few black and white sketches to work with, along with a description. It
Anthropic says its first Fermat runs failed not on math, but because dozens of Claude agents lost track of shared project state. They only succeeded after moving to Prove2Me's DAG of statements and pr
Anthropic PBC has used Claude to create a computer-verifiable version of a famous, highly complicated mathematical proof. The company detailed the project in a blog post published today. A proof is a
I ran a side-by-side ML text-processing and model-training workflow using Fable 5.1 vs. Astra (both on xhigh), and the results could not have been more different. Warning, long post. TL;DR -- Astra co
sycl: attribute device allocations by site (GGML_SYCL_MEMTRACE) (#27631) define two new environment variables to better understand how much memory is being allocated, and when. This has been invaluabl
sycl : fix test-backend-ops CI break && restore Kronecker product FWHT support (#28016) (#28254) Reapply 'sycl : add Kronecker product FWHT support for sizes 384, 640, 768, 12…' (#28184) This reverts
metal : fix memory leak in early return (#28399) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/45438612 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple
Kinling Lo / Rest of World: Businesses in China are experimenting with ways to package and market AI tokens to ordinary consumers, including as credit card rewards and telecom plan bundles — Five unex
I just spent the last 2 hours of my life on a Friday night debugging a strange error in a prod CLI app. EF core was receive a readonlyspan during a Contains query. Normally, this query converted to a
Easily pick up your codex or Claude code sessions in Hermes Have you ever been working in Claude Code or Codex and wished you could pick up this exact session in Hermes Agent? Now there's a single com
From GPT-4 to GPT-6. Sparks was a remarkably prescient paper that got a lot of pushback at the time, but absolutely sensed where the vibes were heading with LLMs based on a lot of qualitative experime
Time for another update! We have been busy and managed to improve the gains substantially (mostly from exploring existing llama cpp PRs and adopting relevant things). Among other things the README.md
GPT-6 is pretty good tbh @viktaur27 @Teslarati The rate of improvement from original GPT to GPT-3 is impressive. If this rate of improvement continues, GPT-5 or 6 could be indistinguishable from the s
A researcher has reported a jailbreak of GPT-6 Astra within a day after release. The attack is described as combination of TIP (Task-in-Prompt) attack from ACL 2025 paper with four other unnamed techn
How we think about the “wiki incident,” where our agents wrote to several internet sites: it’s past time for us to define standards for when and how we share misalignment incidents, not just misalignm
Introducing off-peak hour token rates. DeepSeek-V4-Flash and Pro are now half price outside of 12:00 to 18:00 UTC on weekdays (5am-11am pacific), and all day on weekends! Off-peak pricing will be avai
I have a 5070 Ti and two 5060 Ti (all 16Gb cards). I planned to add another 5070 Ti giving me two pairs of 32Gb each but the NVidia prices have just jumped by 25% where I am and I've found a 3090 Foun
I got a lot of ads for meshy recently and went to try it with hilariously bad results. It apparently can't do anything but decorative figurines. I wanted a body shell for an rc car and it just couldn'
Anyone who has a 3D printer and get use of it finds it incredibly useful for those odd jobs around the house, a missing bracket, a cable router, steam deck holder and so on. In the past if I was missi
Legit think he's stopped caring as much since it's apparent the media is never going to do any reporting on what the fuck is going on with it. oh my goodness -- Trump's hand looked absolutely awful ye
OK, you guys want to start with local vibecoding but don't know how. In the discussions, you recommended that I use Godot. I downloaded it without knowing what it was. I was expecting a library, but i
I've updated my auto_demo_scener project with Ninfer support and a “rewrite based on video” feature that I thought you might find interesting. The project is basically an endless demoscene machine. A
Hiya, NInfer is amazng for Qwen, but lacking for real-world-use. As adoption of issues/pr's was not really what I needed, I created a fork and hit it for this week with 3 concurrent claude code sessio
I've been running Qwen3.8-27B as a local inference server for a production content intelligence pipeline (HVAC industry stuff, lots of long-context retrieval and structured extraction). I have been wa
Note this is separate from privacy - you can make sure your data is not used for training by turning that off in OpenAI and Claude. You can also use an open weights model, but as they continue to impr
OpenAI quietly altered the performance metrics it reported for GPT-6-Astra in ways that favored the new model, and it continues to change others post-launch. Good reporting here from @EmilyForlini htt
Otaku is an LLM frontend, primarily designed for roleplay, an alternative to SillyTavern and the like. However, It also works for general-purpose chat with local backends (including Ollama) or cloud m
Pause OpenAI - they are a deeply unethical company building technology that they are demonstrably not able to control. OpenAI quietly altered the performance metrics it reported for GPT-6-Astra in way
Used qwen3.8-27b in Opencode to make this silly mini-game because I'm not sober: ``` We are going to play a game, it will be the Wikipedia game. The Wikipedia game has the following rules: You will ha
First, I'd like to thank the Qwen and Unsloth teams for the Qwen3.8 27b UD Q4_K_XL. Fits the poor 24GB of 3090 VRAM with 100k context at Q8 and works phenomenally well! Imho if theres anything that ca
Ever since u/jfowers_amd has asked me to help with the Lemonade project (and provided some hardware to test on), I've been trying my best to optimize llama.cpp for AMD setups. This has led me in some
I was running into a lot of posts that praised both the Fixed template and the Sharp template in comparison to the stock one, so I put them to the test. It's not as extensive as it should be for a pap
Qwen3.8-Flash-Next (UD-Q4_K_XL) on a single RTX 3090 24GB + 128GB DDR4 — is this config optimal? Hardware CPU: Intel Core i5-12600K RAM: 128 GB DDR4 @ 3600 MHz GPU: NVIDIA RTX 3090, 24 GB VRAM OS: Win
Really disappointing “Save College Sports Act” segment on GameDay. Not one dissenting opinion. No one speaking up for labor. Most watching don’t know the obvious conflicts of interests. They did a bet
I've been trying the latest models from the frontier labs and honestly, after extensive testing I can not tell the difference between the best open source options. I think the differences are now marg
We benchmarked GPT-6 Astra on hard document parsing and extraction tasks. It is the best frontier model for one-shotting document extraction over short and medium-sized documents: 📊 97.2% over short d
I see a new one being launched every few days... How do these new harnesses compare to claude code, pi etc. has anyone switched from these? which harness to prefer and why submitted by /u/Background-J
I built a denser GGUF format for ternary models: Q2_B3 / “B3S” If you're running a ternary model like BitNet-b1.58 or Ternary-Bonsai, the weights are already restricted to -1, 0, or +1 times a block s
arXiv:2412.06494v2 Announce Type: replace Abstract: Background. Federated learning (FL) has gained wide popularity as a collaborative learning paradigm enabling collaborative AI in sensitive healthcar
arXiv:2609.03129v1 Announce Type: cross Abstract: Several classical machine-learning methods, such as KRRs and SVRs, are both computationally and analytically tractable since their estimators either a
arXiv:2609.03337v1 Announce Type: new Abstract: Every engineered fill is specified by a maximum dry density and an optimum moisture content. Each determination needs a full Proctor test. Published cor
arXiv:2609.04018v1 Announce Type: new Abstract: Quantile treatment effects (QTEs) measure the effect of a treatment on the distribution of an outcome, and their estimation at extreme quantile levels i
arXiv:2601.00038v2 Announce Type: replace-cross Abstract: This work develops an active learning framework to intelligently enrich data-driven reduced-order models (ROMs) of parametric dynamical system
arXiv:2609.03860v1 Announce Type: new Abstract: Retail supply chain operations rely on coupled decision modules that must adapt as requirements evolve. LLMs offer a natural-language interface for this
arXiv:2502.18407v2 Announce Type: replace-cross Abstract: Existing LLM-based agents have achieved strong performance on held-in tasks, but their generalizability to unseen tasks remains poor. Hence, s
arXiv:2609.03992v1 Announce Type: new Abstract: We present Alignment-Free Text-Audiobox (Text-AB), a unified framework for high-quality voice dubbing and full-duplex dialogue synthesis. Building on a
arXiv:2609.03355v1 Announce Type: cross Abstract: Logit-based knowledge distillation for autoregressive language models usually aligns teacher and student next-token distributions over the entire voca
Answer to one of the most asked questions recently: how the acquisition will affect llama.cpp? Short answer: the project continues as-is. Focus will still be: wide range of hardware support (even non-
Anthropic: Anthropic says Claude worked “largely autonomously” over 11 days to formalize the proof of Fermat's Last Theorem in the Lean programming language — We are sharing the first complete compute
Anthropic’s planned initial public offering, potentially valuing the company at up to $2 trillion, will be examined under a novel governance model that places an external Long‑Term Benefit Trust (LTBT
Artificial Analysis: Artificial Analysis Coding Agent Index: GPT-6 Astra scored 67, roughly equal to Claude Opus 5, Fable 5, and Muse Spark 1.3, but trailing leader Fable 5.1's 70 — Fable 5.1 in Claud