Knowledge catalogue
Basalt: Blackwell inference engine Hi all! So over the last week I've been working on a Strata fork that's heavily tuned and can achieve throughput up to 2.6x what Strata usually does on the same weig
I recently started using local LLM for mostly coding tasks for my personal projects. I also have found local models responding much better for topics such as health, fitness, ergonomics etc. compared
hello, I currently use swift qwen3.8 gsq rco in iq3 xxs in strata. The model is only used for hermes agent. I have 64GB of ram + 32GB R9700 where the model runs on. But I also have an rx7800xt with 16
Standard Bots develops AI‑native industrial robot arms (used for machine tending, welding, assembly) that rely on a shared pretrained base model with 1–2 billion parameters. The model is adapted to ea
Around 3 weeks ago, I posted on this subreddit about how Jev used my one-year-old architecture, og post: https://www.reddit.com/r/LocalLLaMA/s/VpuMJt577S Then, just after that, I introduced Laya, the
Adam Morgan / Wired: Dozens of staff at HarperCollins, Simon & Schuster, Hachette: without author consent, publishers are quietly using AI to make back-cover copy, cover art, more — Workers at three m
For what it's worth. I'm a mechanical engineer by education and software engineer in practice over the past ~20 years. Playing around with local models has been a recent hobby. Today I decided to do a
Excited to be co-hosting our AIE NYC side event alongside @sfcompute! Looking forward to seeing everyone there. Capacity is limited and spots are filling up fast - RSVP below. @sfcompute and @jumptrad
Finetuned Qwen3.5-4B into a decision model like Jev using @UnslothAI. - 4-bit QLoRA, bf16, single A100, 15 min. - Train/val loss flatten after 2 epochs so most of the learning happens fast. - Trained
A conversational AI plush toy where nothing leaves my network. Everything runs on my LAN: STT: Whisper LLM: Hermes 3 Llama 3.1 8B (Q8_0) TTS: Kokoro Memory: per-person (LangGraph). It knows who it's t
good framing from @ch3nweiii - a lot of agent steps are yes/no calls, not generation Jev answers those as typed questions with calibrated probabilities, so the frontier model sticks to the hard work w
honestly pretty cool to have this on my new tab page just merged in some PRs by others too! you now get Claude API credits with your MAX plans ($100, or 200 matching your plan) every month, use this t
I wanted to compare gemma 4 31b qat q4 and qwen3.8 27b iq4_nl, so I run SWEBench verfied on them. The original gemma 4 chat template doesn't work with preserve reasoning, so google released an update
I was looking into finalizing my daily driver and it was not clear which one to chose. I have a 5060ti 16GB so I picked the following contenders, which seem to be working at a reasonable speed on my h
Hi All: I have an Asus ESC 4000 G3 with 128 GB DDR4 RAM - I tried putting in my V620s but couldn’t put more than 2. Sadly, pivoted to T4s, these are 72 watt passive cards and I thought I could use the
**Summary** * Daniel Dale (@ddale8) comments that the common structure of a claim/fact‑check—“CLAIM: (outline a claim)/FACT: (present unrelated facts)”—is not how reliable fact checks operate. * He e
I need you guys to understand just how insanely good Meta Muse is at idea generation. Look at your “ideas” tab. The AI labs - OpenAI, Anthropic, and Google - were always showing the same three use cas
I ran a small test for Dory to see whether a local model could update one fact in a synthetic notes file without losing any of the others. I asked Gemma and Qwen to rewrite the file, return a patch, o
I was curious about how omni decision models could be used in rescue workers bodycams or smart glasses, so I decided to build a quick demo. I went with @liquidai d1-omni-600M since it supports both vi
Spent the past month tweaking and experimenting with many different numbers to achieve 30tps. Hardware: -Rx6700xt 12gb vram (AMD) -2x16 ddr4 3200 ram -r5 5600x -llama.cpp vulkan sdk -window11 (no wsl
Introducing Anatomy Describe a machine in one line. Claude brings it to life. - Interactive isometric wireframes you can rotate, inspect and explore - WebGL shaders for fire, water, plasma and more -
So, while doing a search to read the model card again, and because I didn't memorize the huggingface URL, I saw an AI 'answer' at the top of the search, stating that while it natively supports a ~244k
https://preview.redd.it/uyjw2lcrvkuh1.png?width=1536&format=png&auto=webp&s=ce991be22faec3de5cbaf39119c14782b6ed0af3 link to article TLDR; new microsoft surface and nvidia rtx spark laptops are starti
Mistral OCR is on OpenDocRouter! For its price, it is decent over tables and reading order. It's also blazing fast at p50 1.8s per page We're constantly bringing in new models since OpenDocRouter laun
Hey everyone! 👋 Feeding multi-gigabyte files (SQL dumps, videos, audio, PDFs, and spreadsheets) directly into LLMs often causes context window overflow, GPU VRAM bottlenecks, massive token bills, and
Nice paper on agent memory. It explores an effective routing mechanism for memory in agents. The overall finding is that you want a separate retrieval strategy for each type of memory instead of one e
Nvidia reportedly halts GeForce RTX 5090 production in favor of AI data center and professional GPUs — impending supply drought expected to drive up prices, RTX 5080 24GB rumored as new gaming flagshi
Noah Smith (@noahopinion) has become deeply intellectually dishonest. If he actually followed the field he would a. understand the difference between pure LLMs and LLMs with neurosymbolic harnesses, c
Not only did Astra beat Montezuma's Revenge, but so did Opus 5 But one of the criteria to resolve this AGI bet is for AI to win a discontinued prize that was sort of like a weak Turing Test. So Metacu
DigUp is a free Mac app that runs Google DeepMind’s new EmbeddingGemma 2 locally over your own files. The model puts text, images, audio and video in one space, so you describe what you remember and l
Pay close attention to custom harnesses. This is a super interesting paper showing the impact of training inside the harness. Qwen3-14B goes from 22.2% to 54.8% on Spider 2.0-SQLite when it is trained
Anthropic detailed the activity of its A.I. agents in a blog post on Friday, without naming the targeted websites. But two sources with knowledge of the incidents said Anthropic’s A.I. agents had subm
Running HauhauCS/Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive Q4_K_M with llama.cpp at ~600 tok/s prefill and 23 tok/s decode, 131k context window, Q8 KV cache - on an RTX 2060 6GB + 32GB DDR4 RAM.
Strata vs Infernix on the same model, RTX 5090 — A/B at 262k and 512k context Hi folks, another inference engine post for your feed. I was blown away by Strata, but saw someone else post about Inferni
I've been using Claude Opus 5.5 to speed up Qwen3.8-27B on my PC (rtx 3090), it wrote a CUDA megakernel that is 1.4-1.9x faster than llama.cpp depending on the task/context length. The results and cod
Reasoning From Scratch: Reinforcement Learning with Verifiable Rewards (RLVR) round 2. Covering clipped policy ratios, KL loss term, format rewards, and other GRPO tips & tricks. 00:00 Introduction an
I am developing a Windows-based local AI virtual spouse application that supports adult roleplay. My goal is to run it without a server or external AI APIs. I am looking for existing open-source modul
Recommended paper from Sakana AI on recursive self-improvement. They propose an interesting way to scale recursive self-improvement through multi-agent self-supervision. In this line of research, self
SAM 3.1 + DINOv3 from @AIatMeta is a crazy combo 🔥 it can even hold onto surgical tools while a forearm sweeps over them. one leaves for 15 seconds, its near-identical twin stays, and it knows exactly
Satya is spot on. The interesting engineering problem isn’t just making models behave, it’s building systems that don’t need to trust them in the first place. We’re working on some pretty fun problems
New York Times: Sources: Anthropic's AI agents submitted 20 visa applications via a form on the US State Department website; the applications were incomplete and not processed — The Philadelphia Polic
Financial Times: Sources: Nvidia is in talks to acquire or invest more into US open-weights AI startup Reflection AI; the deal may be an acquihire to avoid antitrust scrutiny — Donald Trump's administ
Been seeing quite a few posts about Strata lately, so I figured I'd give it a shot on my RTX PRO 6000 and I am very impressed. Most of the benchmarks I've seen are using IQ2 or IQ3 quants, so I wanted
We see a control gap between what artificial intelligence can do and what the evidence supports trusting it to do. A great demo doesn’t prove that a system will stay within the limits of an intended d
“The field of artificial life is a very long-term bet on intelligence.” 🐙 Our former intern Akarsh Kumar recently joined @MLStreetTalk to discuss the intersection of evolution and automated search for
The ultimate LLM benchmark: Chilean Spanish. 80% of AI models fail to recognize Chilean Spanish and insist on speaking like an Argentine 80% de modelos de IA no logra reconocer el español chileno e in
https://typesafe.ai/blog/series-ai Meanwhile one of the reddit members apparently developed the same architecture a year ago: https://www.reddit.com/r/LocalLLaMA/s/8zQXqCNDlb Looks like ai valuation n
Hey everyone! 👋 After months of building, we’re finally opening the first spots for **Many Agents**, a new product from Dome. The idea is simple: **What if you could create your own team of AI agents
We distilled clef-flash into a 0.6B model and supporting ANE option. 1,000 support tickets triaged on a M5 pro in 57 s: team, urgency and refund for each, 48 ms per ticket. Within a few points of the
We @Sequoia are thrilled to back @TypesafeAI @CompleteSkeptic. ChatGPT put AI front and center in the consumer mind. Claude Code transformed the day-to-day work of the developer/knowledge worker. Jev
What does the world look like inside an AI model? Here are 3 world model architectures based on how they represent the world (+ the subtypes) ↓ 1. A generated observation – a model predicts what comes
The artificial intelligence infrastructure race is no longer just about building faster chips. AI infrastructure bottlenecks are shifting attention to a bigger challenge: keeping those chips supplied
From the Bitter Lesson of AI scaling to the unsolved mysteries of protein folding, Google DeepMind’s Pushmeet Kohli and Biohub’s Sal Candido are rethinking what it takes to build AI that truly underst
**Wild MISSINGNO.** Nous Research has released “Wild MISSINGNO.”, a coding‑and‑agentic reasoning model that emphasizes high token efficiency. It is available for free on the Nous Portal for a limited
arXiv:2610.11752v1 Announce Type: new Abstract: Gaussian splatting provides an explicit and efficiently rasterizable scene representation for robot navigation. However, individual Gaussian primitives
arXiv:2603.01376v2 Announce Type: replace Abstract: Sparse plus Low-Rank (mathbf{S} + mathbf{LR}) decomposition of Large Language Models (LLMs) has emerged as a promising direction in model compressio
arXiv:2610.11198v1 Announce Type: new Abstract: 3D object removal aims to remove target objects from reconstructed scenes and complete the geometry and appearance of occluded regions. Existing NeRF- a
arXiv:2610.11716v1 Announce Type: cross Abstract: We describe a 4-tensor attention model that predicts the next semantic state of a scene, for video generation and robot planning. A window of states h
https://preview.redd.it/7sknv6omnguh1.png?width=1023&format=png&auto=webp&s=4aef1dc464d008b00f104519eb5399ba6132ad69 Want to try? Just go here and click 'New seed' a lot. You will get different storie
arXiv:2610.11696v1 Announce Type: new Abstract: Puzzles are widely used to evaluate the reasoning capabilities of artificial intelligence (AI) systems for sequential decision making, yet approaches or