b11601
hexagon: add configurable HTP DCVS/HMX power mode (#30423) hexagon: add configurable HTP DCVS/HMX power mode hexagon: address PR review feedback (drop CLI flag, align QAIRT power modes, comment/log cl
Knowledge catalogue
hexagon: add configurable HTP DCVS/HMX power mode (#30423) hexagon: add configurable HTP DCVS/HMX power mode hexagon: address PR review feedback (drop CLI flag, align QAIRT power modes, comment/log cl
meta: recreate all subgraphs when the arena is reallocated (#30453) meta: recreate all subgraphs when the arena is reallocated chore: revert added test cases Website: https://llama.app Attestations: h
vulkan: Optimize pool_2d when the pooling window is large (#30119) When the window is larger than a subgroup, use a whole subgroup to compute each output. Website: https://llama.app Attestations: http
kleidiai: add SME2 Q4_K and Q6_K matmul support (#29219) Change-Id: Ib4aa4c9814c010f9cf084783cc80612e364f9a27 Change-Id: I406a6606c3fea51f8cd32331c1ed71466845d363 Change-Id: Ib4aa4c9814c010f9cf084783c
ggml : simplify backend search path error handling (#28367) Signed-off-by: Adrien Gallouët angt@huggingface.co Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestatio
Banger paper from Google DeepMind on co-evolving an agent's harness and its weights. (bookmark it) If you already log your harness changes and results, those logs can become training data for the mode
Dynamic vision, in action Basalt is an inference engine for 3.8 Flash Next, forked from Strata and heavily tuned for Blackwell. It supports vision, and for this to work you need to have the image enco
My project is optimising qwen flash next on Mac Mini m5 64gb through SSD streaming. I recently asked LocalLLama for guidance on how to optimise token output. Today a popular method to do this is a loo
I set up a dedicated workstation for local AI experimentation with various models and tools. But every single one of them wants all the available VRAM. To fix this, I built a request dispatching layer
I built a desktop app harness that keeps local meeting notes and can use them to autocomplete my typing as well as complement my dictation with additional context via reading my screen or using the pr
It's confirmed. OpenAI has been secretly replacing Astra with increasingly shit models since release. My evidence is overwhelming. Three Reddit comments, a benchmark that fluctuated 4%, and a guy who
@cjav_dev @aiDotEngineer @ricmac @latentspacepod our workshop writeup is live now! https://x.com/latentspacepod/status/2109713951604826153?s=20 At AI Engineer New York, Anthropic's @cjav_dev & @Harris
Hi Friends, I am a solo developer. Ever since I had Qwen 3.8 running on my RTX4090, I had an itch to use it on my phone for everything. That gave me the idea to build SteerClaw Mobile - a complete age
Sadly, all the tests were done using NanoGen, but maybe someone can try the idea on Krea 2 or Qwen-Image 2.1. Does our method work beyond ImageNet generation? Yes. We test it on NanoGen, a unified dif
Every few weeks, a new model steps up and claims best-in-class at something. The launch chart makes the case, the link makes the rounds, and your team is back to the question nobody has time for: shou
Quick note, not my character, original came from schmede_AI on youtube. But yes my question is do any local models currently have the ability to match and generate additional images of a character fro
Epic Games plans to use AI to generate code and art for an unannounced Disney game, which is now delayed from its original March release window, according to a report from Bloomberg. The project's dev
A few days ago I posted “Gausify Orbit - I am building a web application to transform images into Gaussian Splats”, and it was removed because the project wasn’t open source yet. It’s now released und
Last week we announced that Gemini Enterprise has evolved to make it even simpler to get work done, and introduced the Gemini agent, your new universal agent for work. It's always on and ready to answ
Gemini 4 Argon is available: — For developers: Build with the Gemini API paid tier and if you’re a Google AI Ultra subscriber, you can try it in @antigravity, @GoogleAIStudio, and @Android Studio. — F
Google LLC today brought its Gemini 4 Argon frontier artificial intelligence model to Gemini app users on its Pro and Ultra subscription plans, two weeks after the model went first to vetted cybersecu
After months sitting on the sidelines of the frontier AI race, Google has finally launched its long-awaited Gemini 4 Argon model, claiming it can compete with the best the industry has to offer. Googl
Robert Hart / The Verge: Google rolls out Gemini 4 Argon globally via the Gemini API and to Google AI Pro subscribers in the Gemini app and AI Mode, and in Antigravity for Ultra users — After months o
GPT-4 was the undisputed best model in the world for a full year and we all debated whether anyone could catch up or if OpenAI had some secret formula that nobody else knew about. Now there are are 19
Grok @Bot memory transfer NEW GROK BOT! AI MEMORY TRANSFER! Your old AI knows you. Your new one shouldn't have to start from zero. 🧠➡️ Meet Memory Transfer, a @Grok @Bot that brings over what Claude o
Grok @Bot rocks I've been using Grok @Bot as my daily driver for a few weeks now and: - it has replaced 100% of my search-like queries on chatgpt / claude - it has replaced 100% of my Hermes usage & a
So I wanted to try the horsey challenge myself on the latest engine i been testing which is a strata fork by sergqwer. https://github.com/sergqwer/strata-nvfp4. I seen a post earlier and seen i believ
A lot of projects have come up recently consisting of specific hardware config specialized forks of existing conferencing engines, but they all seem to be made using Claude or OpenAI's biggest frontie
https://preview.redd.it/m5e9anluo8vh1.png?width=1080&format=png&auto=webp&s=4c80687e6fe40036843a97ed8975ce46eaab0662 I am excited to share a project I have been working on during the past few years du
I spent a decent amount of time with Gemini 4 before launch. Overall, Gemini 4 is a big jump over previous Gemini models and it is the first non-OpenAI/Anthropic model to pass the Fable/Mythos/Astra b
If an agent saves an engineer 2 hours to implement a feature but collectively costs the team 3 hours in alignment and review, the ROI is negative. Isolated chats are suboptimal in team environments be
Hello everyone! My current setup has an RX 7800 XT 16GB GPU + 32GB RAM. I'm currently running Qwen3.8 27B at 4bit with max context 120k at around 40 t/s but the quality isn't that great, and I'd like
Laptops open across the room. Yesterday at AI Engineer New York, @cjav_dev + Harrison Stall of @AnthropicAI on Claude Managed Agents. Claude plans the work, then coordinates the agents. Workshop recap
Learn to build custom harnesses, folks! Here is an impressive paper showing the impact of a good custom harness on long-context work. GLM-5.3-Flash goes from 4.4% to 61.1% exact match on OfficeQA Pro
'A 4-step distilled LoRA for Qwen-Image-2.1, supporting text-to-image generation and image editing. Training was performed entirely on 16 Huawei Ascend 910B NPUs, using DMD in LightX2V.' I think it's
Lipwise is a [yet another] dictation app for Windows, macOS and Linux. You hold a hotkey, talk, and it types into whatever app has focus but with a twist. Since most of us that speak to our computers
Gguf's: https://huggingface.co/LiquidAI/LFM2.5-24B-A2B-GGUF Free Demo: https://playground.liquid.ai 'LFM2.5-24B-A2B is a 24B-parameter reasoning model with only 2B active parameters, built for fast, p
llama.cpp now has a Windows app 🦙 Llama Windows makes it easy to run models locally, with optimizations for NVIDIA RTX Spark. 📥 Browse and download models from Hugging Face 💬 Chat with local models ri
Release: llm-gemini 0.35 I added support to llm-gemini for the new Gemini 4 Argon model, made available today via the Gemini API and for customers of their 100/month subscription plan. Here are the lo
Look up! Mistral models are in orbit 🌍. Proud to join @orbitworksspace and @LoftOrbital's first-of-its-kind AI satellite constellation with @NVIDIAAIInfra. Just a few weeks ago, @orbitworksspace launc
I've been using this for a few days and I was surprised to see nobody had posted it here. It's a vae trained to remove the checkerboard artifacts that qwen image 2.1 produces. It works very well. You
tl;dr: running Qwen3.8FN Q4 locally is cheaper for me than every cloud model except Luna and the newer Haiku at mid-peak and peak electricity pricing where I live, and becomes the absolute cheapest mo
So I’ve only been messing around with Krea2 in ComfyUI for a little while, and I ran into the classic problem: I make an image I really like, then a week later I want the exact same settings back and
When we talk about agents, that doesn't necessarily mean we're talking about Python. In today's modern ecosystem, an agent might run as a high-concurrency Go microservice on Cloud Run, or live inside
i'm the maintainer of dodaios (formerly personal jarvis), an open-source ai agent app for the desktop. apache 2.0, runs on windows, macos and linux, no account and no cloud of ours between you and you
OpenDocRouter makes it dead-simple to start parsing your documents across on ton of frontier Models (gemini, luna) and latest OSS models (LightOnOCR-3, MinerU2.5-pro). Parse your first document in 60
Hi guys! I got a problem with one of my V100 SXM2 Modules. In 'nvidia-smi' its shows with 'Pwr:Usage/Cap' as 'N/A / N/A'. When I try to use it i get the following error in dmesg: NVRM: Xid (PCI:0000:0
Quartermaster (my local inference manager: one server that swaps llama.cpp, image, audio and video models in and out of VRAM) can now help you server and manage decision models: Auto-discovered. Drop
Trying to read on what the real tested downsides have been but information seems to go both ways, some proclaim no loss, others pretty huge ones. I had some weird looping issue in their chat, and some
Redesigning source control at Anthropic Interesting piece from Anthropic describing why and how they built their own custom alternative to Git, based on the dramatic increase in rate of changes to the
Hi, I see that vllm released d3 (a family of decision models) and llama.cpp already has support for them. I want to try them out. Are decision models sensitive to quantization? I know that for autocom
I’ve been building SonicBoom, a native tensor runtime written in C++/CUDA with a C ABI and no Python anywhere in the stack. I just tagged v0.0.1, and the first target is local LLM inference on consume
Sure, Fox News, it's a total mystery why Talarico would allow internet conspiracy mongers to make fools of themselves and the candidate they support. Texas Democratic Senate nominee James Talarico's v
The allegations are false and also I'm resigning Serving as the United States Ambassador to Greece has been the honor of a lifetime. I will forever be grateful to President Donald J. Trump and Secreta
This is today’s edition of The Download, our weekday newsletter that provides a daily dose of what’s going on in the world of technology. Open models have real benefits. Do they outweigh the risks? An
total black eye for Anthropic’s efforts at alignment. Anthropic admits Houthis used Claude AI instead of weapons engineers to make rockets and ballistic missiles that correct themselves after missing
This is an update to my previous post which can be found here: https://www.reddit.com/r/LocalLLaMA/s/n7sgRZZc4z Since my last post I have continued working on the conversion process and also convertin
New version of my MiniMax H3 timeline workflow released Some very important bug fixes included, and a lot of improvements. The YouTube video above includes a lot of tips for using the workflow in addi
On October 13 2026, researcher Ethan Mollick tweeted that observing Gemini 4’s behavior reveals how many other LLMs are likely distilled from Claude or GPT—and thus use a similar training pipeline—mak
We benchmarked Gemini 4 Argon, Muse Wonder, and Muse Spark comprehensively on hard document OCR tasks. They're all pretty good! - Muse Spark and Gemini 4 Argon* are SOTA at their respective price poin