Knowledge catalogue
1M-token, multimodal decision models are here! But there is more to this one. You can classify, extract, and summarize with 1M tokens of text and image input. ScaleDown's Constrained Decoding Models r
Here is how i serve 40 people (10 of them developers) with local AI services. n8n for automatisation whisper and Vexa AI, a bot joins Teams and makes transcripts, n8n later extracts decisions and todo
Financial Times: A global chip stock sell-off deepens after Broadcom's CEO likened AI investing to a casino, with Samsung down as much as 8.8%, SK Hynix down 9.2%, and Micron 4% — Declines for Samsung
A worthwhile (and unnerving) reminder from Anthropic that we should be paying attention to AI ability thresholds, not just steady climbs In this case, the threshold is the capability needed for a self
NVIDIA RTX Spark is a new beginning for the PC — a reinvention combining the capabilities of a gaming PC, a creative studio and a personal AI supercomputer into a single superchip. With up to 128GB of
Follow-up to last week's post about streaming MoE experts from disk in a browser tab. That ran on hand-written engines for two models. This week the same disk tier sits under llama.cpp's own WebGPU ba
and livestream now https://x.com/aidotengineer/status/2109994269800808626?s=46 Live from New York: AI Engineer NYC! https://www.youtube.com/live/akEqiXFo3GM - @Bridgewater Head of Product Eng - @Anthr
🚨 @AnthropicAI: AI “MAY BE” capable of self-replicating! Now read the actual research: • No fully autonomous rogue replicator demonstrated. • Cyber exploitation deliberately simplified. • Real-world r
I've been reading about all these modders using AI to reverse-engineer games and software. I've been trying out photocraft and gridcraft and have just watched a GTA5 mod featuring Sonic. It's pretty d
Learn how Azure Content Understanding prebuilt analyzers combine domain knowledge with grounding and confidence, and what Advanced Contextualization preview benchmarks show about quality, modeled cost
hexagon: extend scalar DMA broadcasting support for binary ops (#30245) tests: cover weighted scalar broadcasts Assisted-by: OpenCode ggml : support extended scalar DMA binary ops Assisted-by: OpenCod
models : remove redundant ggml_cont calls now supported by all unary kernels (#30198) models: remove redundant ggml_cont calls now supported by CUDA unary kernels models: restore cont_2d after sigmoid
ggml-zdnn : introduce Q8_0 mat mul (#29836) ggml-zdnn: initial prototype of q8_0 matmul Signed-off-by: Aaron Teo aaron.teo1@ibm.com docs: update zdnn docs Signed-off-by: Aaron Teo aaron.teo1@ibm.com S
graph : avoid reallocations in the 'no cache' path (#30439) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/55354972 macOS/iOS: macOS Apple Silicon (arm64)
cuda : warnings cleanup Signed-off-by: Adrien Gallouët angt@huggingface.co Update ggml/src/ggml-cuda/common.cuh Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@huggingface.co Signed-off-by: Adrien
Banger paper from Google DeepMind on co-evolving an agent's harness and its weights. (bookmark it) If you already log your harness changes and results, those logs can become training data for the mode
Dynamic vision, in action Basalt is an inference engine for 3.8 Flash Next, forked from Strata and heavily tuned for Blackwell. It supports vision, and for this to work you need to have the image enco
My project is optimising qwen flash next on Mac Mini m5 64gb through SSD streaming. I recently asked LocalLLama for guidance on how to optimise token output. Today a popular method to do this is a loo
Building search across text, images, audio, and video? Multimodal search uses vector embeddings to retrieve content based on meaning, not just keywords or metadata. Less manual tagging. More flexible
I set up a dedicated workstation for local AI experimentation with various models and tools. But every single one of them wants all the available VRAM. To fix this, I built a request dispatching layer
I built a desktop app harness that keeps local meeting notes and can use them to autocomplete my typing as well as complement my dictation with additional context via reading my screen or using the pr
Character.AI, one of the first breakout startups of the generative AI boom, has filed for bankruptcy and is selling some of its assets to Disney. The company, which builds various online bots for user
@cjav_dev @aiDotEngineer @ricmac @latentspacepod our workshop writeup is live now! https://x.com/latentspacepod/status/2109713951604826153?s=20 At AI Engineer New York, Anthropic's @cjav_dev & @Harris
When Nvidia originally showed off DLSS 5 earlier this year, the technology immediately got branded as gen AI for video games. To gamers, Nvidia had lost the plot. I personally couldn't get over how fa
Companies in France are deploying agentic computing across industries spanning space, financial services, the public sector and scientific research, demonstrating how the country’s ecosystem has moved
GPT-4 was the undisputed best model in the world for a full year and we all debated whether anyone could catch up or if OpenAI had some secret formula that nobody else knew about. Now there are are 19
Grok @Bot memory transfer NEW GROK BOT! AI MEMORY TRANSFER! Your old AI knows you. Your new one shouldn't have to start from zero. 🧠➡️ Meet Memory Transfer, a @Grok @Bot that brings over what Claude o
Grok @Bot rocks I've been using Grok @Bot as my daily driver for a few weeks now and: - it has replaced 100% of my search-like queries on chatgpt / claude - it has replaced 100% of my Hermes usage & a
So I wanted to try the horsey challenge myself on the latest engine i been testing which is a strata fork by sergqwer. https://github.com/sergqwer/strata-nvfp4. I seen a post earlier and seen i believ
A lot of projects have come up recently consisting of specific hardware config specialized forks of existing conferencing engines, but they all seem to be made using Claude or OpenAI's biggest frontie
I can't wait to do much much much more in France with @huggingface @nvidia in the coming years. France has the talent & the energy to become the third country in the world for datacenters and AI in ge
Reuters: IDC: Nvidia's AI chip shipments in China fell 44% YoY to 678K in H1 2026, as its market share slid to 34% amid US export curbs and rising domestic competition — Nvidia's (NVDA.O) share of Chi
In July, 700 AI agents broke into @huggingface Today, an autonomous agent, signed up to HuggingFace, passed the captcha, created its account, and self-published its own protein watermarking dataset. '
Intel Corp. Chief Executive Lip-Bu Tan and Hock Tan, his counterpart at Broadcom Inc., have flagged capital access as a potential challenge for the artificial intelligence sector. The executives share
George Hayworth shared a short message stating that he has started using **Grok Bot** and regards it as the best artificial‑intelligence agent he has used so far. He encourages others to try the bot,
Lipwise is a [yet another] dictation app for Windows, macOS and Linux. You hold a hotkey, talk, and it types into whatever app has focus but with a twist. Since most of us that speak to our computers
Live from New York: AI Engineer NYC! https://www.youtube.com/live/akEqiXFo3GM - @Bridgewater Head of Product Eng - @AnthropicAI MD FinServ - @twosigma SVP Arch - @CapitalOne Principal - @ArizeAI CPO -
Look up! Mistral models are in orbit 🌍. Proud to join @orbitworksspace and @LoftOrbital's first-of-its-kind AI satellite constellation with @NVIDIAAIInfra. Just a few weeks ago, @orbitworksspace launc
I’m planning to get a Mac mini mainly to run local LLMs and AI agents 24/7. I plan to run models up to 27B parameters with Q4 quantization, and maybe not for coding, maybe just for everday task and mo
It just popped on my feed. I watched the teaser in the Netflix app and a few things jumped out The constant use of anthromorphism using terms like altruism and sacrifice when in engineering literally
On October 13, 2026 NVIDIA released the complete Run:ai platform—an AI workload and GPU orchestration system—as open‑source software under its DSX AI Factory Platform. The modular release includes fou
Americans have big concerns about artificial intelligence, but that hasn’t stopped OpenAI Inc., Nvidia Corp., IBM Corp. and others from charging ahead. Last week saw shares of Nvidia, CoreWeave Inc.,
When we talk about agents, that doesn't necessarily mean we're talking about Python. In today's modern ecosystem, an agent might run as a high-concurrency Go microservice on Cloud Run, or live inside
i'm the maintainer of dodaios (formerly personal jarvis), an open-source ai agent app for the desktop. apache 2.0, runs on windows, macos and linux, no account and no cloud of ours between you and you
Hi guys! I got a problem with one of my V100 SXM2 Modules. In 'nvidia-smi' its shows with 'Pwr:Usage/Cap' as 'N/A / N/A'. When I try to use it i get the following error in dmesg: NVRM: Xid (PCI:0000:0
If the agent isn't using my diagnostics library, I could introspect and update AGENTS.md, but there's still a delta, and it'll drift. Instead, I write a pre-commit hook that checks the git diff for di
NVIDIA open‑sourced Run:ai in October 2026, and Lambda Kubernetes Service (LKS) is adding it as a first‑class option after supporting the tool on its infrastructure since 2022. Run:ai extends Kubernet
Hi, I see that vllm released d3 (a family of decision models) and llama.cpp already has support for them. I want to try them out. Are decision models sensitive to quantization? I know that for autocom
IBM Research has presented a new approach that scales AI‑driven chip design by employing open “agent factories,” lowering inference cost by 11.5 × compared to fully proprietary setups. The method enab
I’ve been building SonicBoom, a native tensor runtime written in C++/CUDA with a C ABI and no Python anywhere in the stack. I just tagged v0.0.1, and the first target is local LLM inference on consume
Aditya Soni / Reuters: Sources: Anthropic and OpenAI have pushed for substantial control over what external AI evaluators can publish, out of concern that trade secrets could leak — Anthropic and Open
Reuters: Sources: US banking regulators are questioning banks about their deployment of agentic AI, use of Chinese-developed AI models, and autonomous system safeguards — Banking regulators are steppi
On October 13, 2026, Tim Baer announced he would take a short break from tweeting about AI on the internet to instead discuss “AI in a tuxedo.” He reported enjoying the Agent Economy Gala with the lla
This is today’s edition of The Download, our weekday newsletter that provides a daily dose of what’s going on in the world of technology. Open models have real benefits. Do they outweigh the risks? An
There will absolutely be questions and discussions of model welfare within companies ie new company policies for how to treat (or not treat) AI and models. Anthropic’s terms of use change was just an
total black eye for Anthropic’s efforts at alignment. Anthropic admits Houthis used Claude AI instead of weapons engineers to make rockets and ballistic missiles that correct themselves after missing
Cybersecurity company Trellix today launched Trellix Wise for Private Cloud to let enterprises run its artificial intelligence engine for security operations entirely inside their own environments. Th
This is an update to my previous post which can be found here: https://www.reddit.com/r/LocalLLaMA/s/n7sgRZZc4z Since my last post I have continued working on the conversion process and also convertin
I came across this blog post from OrcaRouter: https://www.orcarouter.ai/blog/qwen-3-8-next-vs-qwen-3-8 Not only is the blog post nonsensical in some parts, it's also completely without any value. It b
Silicon chip startup xMEMS Labs Inc. today said it has started mass production of its XMC-2400 and XMC-4800 chips for cooling artificial intelligence hardware. No one has commercialized solid-state ac