All entries

tl;dr: running Qwen3.8FN Q4 locally is cheaper for me than every cloud model except Luna and the newer Haiku at mid-peak and peak electricity pricing where I live, and becomes the absolute cheapest mo

Orca Security built Discovery AI, a natural language query agent on Amazon Bedrock that converts plain-English questions into Sonar queries. The post shares the multi-stage architecture and the result

It just popped on my feed. I watched the teaser in the Netflix app and a few things jumped out The constant use of anthromorphism using terms like altruism and sacrifice when in engineering literally

I'm sure some here read this at the time and remember, but I recently found this hilarious Guardian article from 2019 through Wikipedia: https://www.theguardian.com/technology/2019/feb/14/elon-musk-ba

New on our Engineering blog: Creating in-house source control. In May, we merged around 2,500 code changes per day. In September, we merged more than 30,000 per day. As a result, we became bottlenecke

So I’ve only been messing around with Krea2 in ComfyUI for a little while, and I ran into the classic problem: I make an image I really like, then a week later I want the exact same settings back and

On October 13, 2026 NVIDIA released the complete Run:ai platform—an AI workload and GPU orchestration system—as open‑source software under its DSX AI Factory Platform. The modular release includes fou

.@NVIDIARTXSpark VFX nodes are now in ComfyUI, with first class support for EXR files format. → RTX Video Super Resolution: upscale, denoise, deblur → RTX Video Frame Generation: new in-between frames

Americans have big concerns about artificial intelligence, but that hasn’t stopped OpenAI Inc., Nvidia Corp., IBM Corp. and others from charging ahead. Last week saw shares of Nvidia, CoreWeave Inc.,

When we talk about agents, that doesn't necessarily mean we're talking about Python. In today's modern ecosystem, an agent might run as a high-concurrency Go microservice on Cloud Run, or live inside

i'm the maintainer of dodaios (formerly personal jarvis), an open-source ai agent app for the desktop. apache 2.0, runs on windows, macos and linux, no account and no cloud of ours between you and you

OpenDocRouter makes it dead-simple to start parsing your documents across on ton of frontier Models (gemini, luna) and latest OSS models (LightOnOCR-3, MinerU2.5-pro). Parse your first document in 60

Hi guys! I got a problem with one of my V100 SXM2 Modules. In 'nvidia-smi' its shows with 'Pwr:Usage/Cap' as 'N/A / N/A'. When I try to use it i get the following error in dmesg: NVRM: Xid (PCI:0000:0

https://preview.redd.it/p6i9qifyy8vh1.png?width=2069&format=png&auto=webp&s=2b1e3c7c4fc95f12f0f7d417a4d21410aebfbd35 The 3090 Founders edition has a reputation for hot VRAM. Since LLM token generation

Quartermaster (my local inference manager: one server that swaps llama.cpp, image, audio and video models in and out of VRAM) can now help you server and manage decision models: Auto-discovered. Drop

If the agent isn't using my diagnostics library, I could introspect and update AGENTS.md, but there's still a delta, and it'll drift. Instead, I write a pre-commit hook that checks the git diff for di

Trying to read on what the real tested downsides have been but information seems to go both ways, some proclaim no loss, others pretty huge ones. I had some weird looping issue in their chat, and some

Redesigning source control at Anthropic Interesting piece from Anthropic describing why and how they built their own custom alternative to Git, based on the dramatic increase in rate of changes to the

Robots. Servers. Machines that dream. All shot on a film stock that remembers 1985. Tomorrow, filmed like yesterday. What if AI had been filmed in 1985? Visuals: @grok @imagine . Direction assisted by

Robots That Predict the Future: Dyna-2, Million-Hour World Models, & the Bitter Lesson of Robotics @DynaRobotics’s @JasonMa2020 explains how world-action models predict the future to guide physical ro

router lives in the harness, not a gateway, bc the harness knows the task blog: https://www.langchain.com/blog/how-to-build-a-model-router-in-the-harness https://x.com/neil_xbt/status/2109979966859510

NVIDIA open‑sourced Run:ai in October 2026, and Lambda Kubernetes Service (LKS) is adding it as a first‑class option after supporting the tool on its infrastructure since 2022. Run:ai extends Kubernet

Hi, I see that vllm released d3 (a family of decision models) and llama.cpp already has support for them. I want to try them out. Are decision models sensitive to quantization? I know that for autocom

IBM Research has presented a new approach that scales AI‑driven chip design by employing open “agent factories,” lowering inference cost by 11.5 × compared to fully proprietary setups. The method enab

More AI agents will soon be able to browse and purchase from Shopify listings, marking an expansion of the company's agentic commerce ambitions. Shopify announced Tuesday it will let shoppers configur

I’ve been building SonicBoom, a native tensor runtime written in C++/CUDA with a C ABI and no Python anywhere in the stack. I just tagged v0.0.1, and the first target is local LLM inference on consume

Aditya Soni / Reuters: Sources: Anthropic and OpenAI have pushed for substantial control over what external AI evaluators can publish, out of concern that trade secrets could leak — Anthropic and Open

Katie Roof / Business Insider: Sources: Decagon, which offers AI customer service agents and was last valued at $4.5B, hired a bank and is in early talks with buyers, including ServiceNow — Buzzy AI a

Stephanie Palazzolo / The Information: Sources: self-driving simulation software maker Applied Intuition has received investment offers that would value it at 30B+, up from 15B in June — For the last

Reuters: Sources: US banking regulators are questioning banks about their deployment of agentic AI, use of Chinese-developed AI models, and autonomous system safeguards — Banking regulators are steppi

Physical AI needs context about its surroundings to adapt beyond a fixed set of instructions. Munich-based Spranic is building a spatial memory layer that records physical spaces and how they change.

Suggestion for you: Pick an agent for work, and pick an agent for personal. You could explore to do this all with Grok Bot (with many different types of bots) Personally, I like @bot for work, and @Mu

Sure, Fox News, it's a total mystery why Talarico would allow internet conspiracy mongers to make fools of themselves and the candidate they support. Texas Democratic Senate nominee James Talarico's v

On October 13, 2026, Tim Baer announced he would take a short break from tweeting about AI on the internet to instead discuss “AI in a tuxedo.” He reported enjoying the Agent Economy Gala with the lla

Imaan Sultan posted on October 13, 2026 to thank attendees of the Agent Economy Gala and highlight his collaboration with Sarah Fan in planning the event. He noted his role in proudly representing lla

The allegations are false and also I'm resigning Serving as the United States Ambassador to Greece has been the honor of a lifetime. I will forever be grateful to President Donald J. Trump and Secreta

This is today’s edition of The Download, our weekday newsletter that provides a daily dose of what’s going on in the world of technology. Open models have real benefits. Do they outweigh the risks? An

There will absolutely be questions and discussions of model welfare within companies ie new company policies for how to treat (or not treat) AI and models. Anthropic’s terms of use change was just an

This is my new favorite way to keep up with AI papers. I turn my curated papers into a 2-minute spoken technical briefing with @FishAudio Drama 3, straight from Codex. In the demo, I took one of my fa

this is wild... all open source? are you kidding me What if Spotlight actually understood the meaning inside your files? DigUp is an open-source macOS menu bar app powered by EmbeddingGemma 2 that bri

Today, we’re open sourcing the full NVIDIA Run:ai platform as part of the NVIDIA DSX AI Factory Platform. Developers, platform teams, and partners can build on production-grade AI workloads and GPU or

total black eye for Anthropic’s efforts at alignment. Anthropic admits Houthis used Claude AI instead of weapons engineers to make rockets and ballistic missiles that correct themselves after missing

We trained a model on agentic coding tasks using fully asynchronous RL and mixed-precision, mixed-accelerator samplers. With off-policy correction, training stayed stable through convergence, on par w

Cybersecurity company Trellix today launched Trellix Wise for Private Cloud to let enterprises run its artificial intelligence engine for security operations entirely inside their own environments. Th

Two announcements today for the visit of @JensenHuang in France: https://inria.fr/fr/la-fondation-inria-annonce-la-constitution-dun-groupe-de-travail-pour-ladoption-de-lia-open-source with @Inria http

This is an update to my previous post which can be found here: https://www.reddit.com/r/LocalLLaMA/s/n7sgRZZc4z Since my last post I have continued working on the conversion process and also convertin