Knowledge catalogue
This Reddit post discusses a technical setup for running Ollama with three NVIDIA RTX 3060 GPUs (each with 12GB VRAM) on a Machinist motherboard paired with a Xeon processor and 32GB of system RAM. Th
A discussion about difficulties getting Ollama to fully utilize dual NVIDIA RTX 3090 GPUs when running various language models including 8B and 70B parameter models. Users report that despite Ollama r
Nemotron-Labs Diffusion Language Models represent NVIDIA's approach to achieving faster text generation through diffusion-based architectures, potentially offering significant speed improvements over
Breaking: Andrej Karpathy just filed his Q1 2026 13F. Here's everything you need to know about his recent 13F Top 10 positions: 1. VanEck Semiconductor ETF - SMH - [Put] — 2.04B 2. Nvidia - NVDA - [Pu
arXiv:2603.20421v2 Announce Type: replace-cross Abstract: We present Hawkeye, a system for analyzing and reproducing GPU-level arithmetic operations. Using our framework, anyone can re-execute on a CP
The AMD Ryzen AI Max+ 395 'Strix Halo' APU outperforms the NVIDIA RTX 5080 by up to 3x in AI benchmarks, particularly for language models, with 128GB of accessible VRAM compared to the RTX 5080's 16GB
GridCare Inc., a startup that helps data center operators more quickly connect their facilities to the electrical grid, has raised 64 million in funding. Early Nvidia Corp. backer Sutter Hill Ventures
This playbook provides step-by-step instructions for running Nous Research's Hermes Agent locally on NVIDIA DGX Spark using Ollama, enabling users to deploy an open-source AI agent entirely on local h
almost all LLM “thought” is derivative. below just sounds like hype to me 📁 Jensen Huang, CEO of NVIDIA, says GPT was never just about generating images or text but about generating thought itself. Th
arXiv:2605.11255v1 Announce Type: new Abstract: We present Hebatron, a Hebrew-specialized open-weight large language model built on the NVIDIA Nemotron-3 sparse Mixture-of-Experts architecture. Traini
Span, Nvidia, and PulteGroup are testing home-based data center nodes that use unused grid capacity to cut costs, ease community pushback, and support growing AI demand. The Span installation bundles
DeepSeek-V4 makes million-token context a serving-systems problem. Together AI explores the inference work behind V4 on NVIDIA HGX B200, including compressed KV layouts, prefix caching, kernel maturit
arXiv:2605.00519v2 Announce Type: cross Abstract: The operational landscape of local Large Language Model (LLM) inference has shifted from lightweight models to datacenter-class weights exceeding 70B
Reuters: Cerebras seeks a valuation of up to 26.62B in its US IPO, aiming to raise 3.5B by selling 28M shares at 115 to 125 apiece in its second attempt to go public — Nvidia-rival Cerebras is seeking
Ollama's MLX engine runs on NVIDIA GPUs via CUDA v13 on Windows and Linux. Users have reported that Ollama crashes on RTX 3060 with cuda_v13 in versions 0.13.0 through 0.15.6, while deleting the cuda_
All the Doomers and hawks are lining up behind this distillation 'attack' farce because they want to see open source banned. It's really as simple as that. They want to take away your right to choose,
v0.22.1-rc1 is a pre-release version of Ollama that includes improvements to MLX sampler batching, tokenizer BPE offset handling, NVIDIA TensorRT Model Optimizer support, and fixes for desktop app sta
Production low-latency autocomplete implementations employ diverse strategies including inference server optimization (tools like vLLM, llama.cpp, NVIDIA Triton), deployment choices (cloud APIs, on-pr
This entry describes NVIDIA's NV-Raw2Insights-US AI model, which uses physics-informed machine learning to enhance ultrasound imaging by adaptively processing raw ultrasound data. The system applies d
LTX Desktop 1.0.5 is an open-source desktop app for generating videos with LTX models on Windows/Linux NVIDIA GPUs locally or via API . The version 1.0.5 release includes bug fixes such as LTX API ins
Nemotron-3 is an open-source language model available through Ollama's model library, likely representing NVIDIA's Nemotron-3 family of instruction-tuned models designed for various NLP tasks. The mod
NVIDIA Nemotron 3 Nano Omni is a multimodal large language model that unifies video, audio, image, and text understanding for enterprise Q&A, summarization, transcription, and document intelligence, w
Elon’s influence was monumental to OpenAI. The reality is there simply wouldn’t have been the AI world we have today. It is not perfect. But would have been orders of magnitude worse. This is the way
The NVIDIA Tesla K80 is a legacy GPU that can run modern LLMs through Ollama with community-maintained patches, since official Ollama dropped support for CUDA Compute Capability 3.7 hardware. Each K80
Intel's server chip volume up sequentially for 3 straight quarters but still less than 52% vs prior peak in 1Q20-1Q26 time period. However, ASPs up 14% vs prior peak in the same period. DCAI revenue a
We've got all the models here: https://dell.huggingface.co/authenticated/models Kimi K2.5, Mistral, Cohere, Arcee AI Trinity Large, Google Gemma, Meta/Llama, Qwen, Nvidia Nemotron, Grok, GPT OSS, Deep
Necessity is the mother of kv-cache optimisation I’m still amazed that DeepSeek, Kimi, and Qwen can train very strong LLMs with far fewer and often nerfed NVIDIA GPUs, or even Huawei chips. DeepSeek V
This article demonstrates running Gemma 4, Google's open-weight language model, on NVIDIA's Jetson Orin Nano Super edge computing device. It likely covers the model's capabilities, performance metrics
From vibe-coded and large-scale apps to AI models and agents, Cloud Run delivers on-demand compute with zero overhead and pay-per-use pricing for all of your workloads. Last year, the number of extern
This article explains how to ground Korean AI agents in realistic demographic data by utilizing synthetic personas, likely leveraging NVIDIA's Nemotron models available on Hugging Face. The approach e
Today, we are thrilled to announce the availability of G7e instances powered by NVIDIA RTX PRO 6000 Blackwell Server Edition GPUs on Amazon SageMaker AI. You can provision nodes with 1, 2, 4, and 8 RT
Eunice Xu / South China Morning Post: Chinese PCB maker Victory Giant surges ~57% in its Hong Kong trading debut after raising ~2.6B in its IPO, the largest in the city so far this year — Nvidia suppl
This post compares two high-end graphics cards—the AMD Radeon RX 7900 XTX and NVIDIA GeForce RTX 4070 Ti Super—across multiple demanding workloads including gaming, AI image generation with Comfy UI,
Stunning views and just as jaw-dropping of presentations at the @cerebral_valley Gemma 4 Launch Party tonight! @vllm_project @UnslothAI @Ollama @huggingface @cactuscompute @apple @nvidia @pytorch and
Nous Research demonstrated strong performance results using their Hermes agent with Qwen 3.5 35B model on an NVIDIA RTX 4090 GPU, highlighting competitive capabilities of locally-run models compared t
This r/StableDiffusion post addresses a common issue where users running Stable Diffusion on an NVIDIA GTX 1660 Ti GPU receive only black images as output instead of generated content. The problem is
This Reddit post from r/ollama discusses a user's experience running Cline (an AI coding agent) with Ollama on a high-end local hardware setup consisting of an NVIDIA RTX 4090 with 24GB VRAM and an In
A Reddit user shared a community-made patch to enable proper FP16 support for the Ernie Image model in ComfyUI, targeting NVIDIA 20-series (Turing) GPUs. 20-series cards do not support bfloat16 , and
Lyra 2.0 is an NVIDIA research project that extends the original Lyra framework for generative 3D world creation, using a self-distillation approach to distill the implicit 3D knowledge in video diffu
This r/StableDiffusion post demonstrates running AceStep 1.5 XL Turbo alongside LTX Video 2.3 on a laptop equipped with an 8GB NVIDIA RTX 5060 GPU — a notable feat given that the XL (4B) model require
A bug was identified in NVIDIA's cuBLAS library where `cublasSgemmStridedBatched` dispatches the same suboptimal `cutlass_80_simt_sgemm_128x32_8x5` kernel for every batched FP32 workload from 256×...
For users running Ollama on an NVIDIA RTX 4060 Ti with 8GB VRAM and 16GB system RAM, the community consensus recommends 7B–8B parameter models (such as Llama 3.1 8B, Mistral 7B, or Qwen 8B) using Q...
1️⃣✅❌ 2️⃣✅❌ 3️⃣✅❌ One of the benefits of Deep Agents deploy is model optionality Choose from models from @OpenAI @GeminiApp @AnthropicAI @FireworksAI_HQ @baseten @OpenRouter @ollama @nvidia and many o
llama.cpp release **b8737** is a focused maintenance build that adds missing CUDA error handling to the ggml backend. Specifically, it checks the return values of NVIDIA CUB library calls used in t...
New course: Efficient Inference with SGLang: Text and Image Generation, built in partnership with LMSys @lmsysorg and RadixArk @radixark, and taught by Richard Chen @richardczl, a Member of Technical
Building and serving models on infrastructure is a strong use case for businesses. In Google Cloud, you have the ability to design your AI infrastructure to suit your workloads. Recently, I experiment
The chart says GLM-5.1 scored 54.9 on coding benchmarks. Three points behind Claude Opus 4.6. Interesting but not the story. The story is what trained it. Zero Nvidia GPUs. 100,000 Huawei Ascend 910B
The drumbeat over how safe artificial intelligence is — or more to the point, isn’t — just keeps louder. In the wake of weeks of incidents involving rogue agents, with likely more to come, more govern
Reflection AI's Beam is an open-weight model for agentic coding and long-horizon tasks. This post shows how to deploy Beam on AWS: start with an Amazon SageMaker JumpStart real-time endpoint, or use A
day 0 support for two new Nemotrons minutes later new Nemotron 3.5 Super VL was released: https://huggingface.co/unsloth/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B https://huggingface.co/unsloth/NVIDIA-Ne
Hey r/LocalLlama - Today we’re excited to release Muse Spark Open, the most capable US open-weight model to date. Built for coding and agentic work, it excels at long-horizon tasks, complex software e
tokenmaxxing: dead and buried. New: Accenture has told employees it will only fund 29 per month of Claude use. Meaning that employees who often spend as much as 1,000 a month are now scrambling to fin
Every local setup I tried for Qwen-Image 2.1 meant a Python env, a node graph and an evening of picking quantization, offloading and resolution for my card. Kokon is a free, open-source desktop app th
Hey everyone, I recently put together a local LLM machine using mostly second hand hardware. I wanted to experiment with local models for app development without spending a fortune on a new workstatio
New impressive work from Microsoft and collaborators. And it's one of my favorite recent topics: RL environments. They show that Qwen3.6-35B-A3B goes from 41.1 to 53.3 on Terminal-Bench 2.1 by trainin
The cancelation of the Grace Hopper Conference may actually point to a reduction in overall junior-level recruitment and job growth. I spoke about AI at GHC 2018, and it was 20,000+ attendees, majorit
Cisco Systems Inc. took to the stage at the annual Open Compute Project Global Summit today, unveiling a new suite of open silicon and optical networking systems as it delivered one of the event’s mos
Learn how to deploy decision models with llama.cpp on Amazon SageMaker AI. This technical how-to serves OpenAI-compatible chat completions with the AWS Deep Learning Container for llama.cpp, then exte
https://preview.redd.it/3ekngxk224vh1.png?width=1080&format=png&auto=webp&s=9bfe5c92033e17d5b2fb4529f1320c99455a138b I built a GPU compiler and wrote an article about it, focusing on concepts shared b
It's been 4 years since c.ai first hallucination model, and yet, we're nowhere good enough at LLMs in terms of spontaneity/interesting hallucination features. Fortunately, last year brought new archit