b10950
ggml-cuda: fallback to F32 on device without BF16 hardware acceleration (#28846) ggml-cuda: fallback to F32 on device without BF16 hardware acceleration: (Nvidia >= AMPERE, AMD >= RDNA3 or = CDNA) app
Knowledge catalogue
ggml-cuda: fallback to F32 on device without BF16 hardware acceleration (#28846) ggml-cuda: fallback to F32 on device without BF16 hardware acceleration: (Nvidia >= AMPERE, AMD >= RDNA3 or = CDNA) app
TorchServe is no longer maintained, leaving teams to own the entire GPU inference stack. The AWS Ray Serve Deep Learning Container is a supported, pre-tested container with the framework, GPU drivers,
Benchmark two 30B Mixture-of-Experts models, Qwen3-Coder-30B and NVIDIA Nemotron-3-Nano-30B, across G5, G6, G6e, and G7 GPU instances on Amazon SageMaker AI. Compare throughput, latency, and cost-per-
Ari Levy / CNBC: Qualcomm signs a deal with Amazon to provide “multiple generations of customized silicon” to help build AWS' AI infrastructure for inference; QCOM jumps ~5% — Qualcomm shares rose 4%
model: add NVIDIA Nemotron-3-Puzzle-75B-A9B (NemotronHPuzzle) support (#25444) hparams: add per-layer n_ff_exp/n_expert_used arrays with scalar-or-array loading G1/G2 infrastructure for variable-per-l
Congrats Clem, Thom, Julien, Lysandre, and the entire Hugging Face team. Proud of all of you! The impact of HF in the AI ecosystem has been massive, and I'm so so excited to see them scale that impact
I’ve been experimenting with neural rendering outside a game engine and built a native Windows video player around it. It prepares a neural-rendered version of a video, caches it, and lets you switch
Erin Griffith / New York Times: PitchBook: 95+ investors put money into both Anthropic and OpenAI amid shifting norms; sources: Menlo, Lightspeed, and Iconiq each hold 1%-2% Anthropic stakes — As the
Repost because reddit keeps thinking this is piracy or illegal. It is neither. A lot of people are skeptical Nvidia will keep huggingface intact now that they will buy huggingface. There's a lot of do
A lot of people are skeptical Nvidia will keep huggingface intact now that they will buy huggingface. There's a lot of doom and gloom about not having any alternatives, removing nsfw models, saying th
The SageMaker Python SDK v3 redesigns script mode with unified ModelTrainer and ModelBuilder classes. This post walks through two end-to-end examples, a scikit-learn Random Forest and a multi-GPU Stab
New York Times: Ukrainian officials say an AI-guided, fully autonomous Russian drone killed three Ukrainians in a strike on a gas station in the city of Zaporizhzhia — An attack by what Ukrainian offi
New/Old benchmark that provides a lot of answers for local LLM. I present to you a new test that I developed somewhat by accident: https://huggingface.co/cHunter789/Qwen3.8-27B-i1-IQ4_KS_KT-GGUF/tree/
AI bull reluctantly acknowledging some cracks in the story Over the past week, we are seeing some early cracks in our GPU availability data...not going to overreact but have to call balls and strikes.
AI is becoming a new computing model for media and entertainment. AI is becoming a new computing model for media and entertainment. At the 2026 Runway AI Summit, NVIDIA’s Richard Kerris explored how r
Nemotron 3.5 Lightning is available on Together AI through Dedicated Model Inference, giving teams reserved capacity and predictable performance for high-volume agent workloads. Start building: https:
seems to be about as good as a vega 56 with 16Gb of VRAM, is it worth it? (don’t want to deal with NVIDIA drivers on Linux, already have an rx6650xt and might simply use vulkan for llamacpp inference)
Nearly every major AI lab uses Google Cloud infrastructure, including for training of models, inference for agents, and new frontier research. Google Cloud also continues to be the platform of choice
two weeks ago i went on @swyx's pod and said some things that i... should not have said. a lot has happened since then, i owe you all an apology. i'm sorry that i was right about every single thing. a
# Running DeepSeek-V4-Flash-0731 (155 GB MoE) on a DGX Spark with vLLM-Moet 2-bit quantization I used Deepseek-v4-Flash-0731 cloud API settig up vllm-moet to run deepseek-v4-flash with MTP locally on
Wall Street Journal: Anthropic faces backlash from Silicon Valley partners, founders, and researchers for competitive tactics, guardrails, and lack of support for open-weight models — The AI pioneer f
Setup as follows: Proxmox -> Debian -> Docker -> Ollama. Other containers work. Compose file contains gpu device. Does it need nvidia runtime or any other options? If someone could provide an example
Title: “don’t do this” refers to a conversation on Twitter where Jerry Liu warns against a particular action, while Julian Schrittwieser comments on a separate thread expressing excitement that Jensen
Everything runs through WebGPU, in-browser or in electron/tauri apps. It's fully portable and supports either Nvidia and Apple Silicon (Metal). The actual kernels are optimized for the specific hardwa
Vera Rubin NVL72 is Nvidia’s second‑generation, rack‑scale Oberon architecture that achieves inference gains through extreme co‑design. Early engineering‑sample data from CoreWeave show DeepSeek R1 de
Decoupling embedding from ingestion means whatever hardware is on hand can do the work. One script, runtime device check: MPS on Apple Silicon, CUDA on NVIDIA, CPU fallback otherwise. 10K-20K records
Chinese AI startup DeepSeek is developing its own inference chips to reduce Nvidia dependence and break U.S. export controls, as China moves to protect its AI ecosystem. DeepSeek has been quietly deve
The July 4th weekend All-In @theallinpod turned into a long argument about who owns the intelligence layer. The besties think enterprises just woke up to a trap they had been walking into, here's how
Highlighting recent advances in multi-GPU and tensor parallel support in llama.cpp Over the last few months llama.cpp maintainers and engineers from NVIDIA collaborated to improve the multi-GPU perfor
Nemotron 3 Ultra is an advanced language model released by NVIDIA, representing an improvement over previous versions in the Nemotron series with enhanced capabilities for various NLP tasks. The annou
arXiv:2601.22813v2 Announce Type: replace Abstract: The NVFP4 lower-precision format, supported in hardware by NVIDIA Blackwell GPUs, promises to allow, for the first time, end-to-end fully-quantized
Teach an agent a workflow once. Have it remember after every rebuild. This tutorial shows how to deploy @nousresearch Hermes Agent with NVIDIA NemoClaw and OpenShell, connect it to Slack, Outlook, Git
This post from Dylan Patel discusses how PC graphics capabilities were limited before Jensen (likely referring to Jensen Huang of NVIDIA) introduced revolutionary GPU technology, and suggests that the
someone else seeing what i am seeing: 🚨 MICHAEL BURRY JUST WARNED THE ENTIRE AI BOOM MAY BE BUILT ON TEMPORARY DEMAND. He published a post today calling Nvidia 'the North Star, Orion, the whole Milky
arXiv:2605.16259v1 Announce Type: cross Abstract: While real-time image generation using diffusion models has advanced rapidly on NVIDIA GPUs, systematic optimization research on non-CUDA platforms su
arXiv:2603.01960v2 Announce Type: replace-cross Abstract: TiledAttention is a scaled dot-product attention (SDPA) forward operator for SDPA research on NVIDIA GPUs. Implemented in cuTile Python (TileI
Jensen Huang describes his early collaboration with Elon Musk, noting that he provided computational support for Tesla's Model S and Model 3 vehicles through NVIDIA technology. Huang credits this prof
The GB300 is the best AI computer Two frontier labs. One accelerated computing platform. Congrats to @SpaceX and @AnthropicAI on the new compute partnership, powered by 220,000+ NVIDIA GPUs inside Col
Two frontier labs. One accelerated computing platform. Congrats to @SpaceX and @AnthropicAI on the new compute partnership, powered by 220,000+ NVIDIA GPUs inside Colossus 1. The future of AI runs on
torch-nvenc-compress is a Python library that leverages GPU NVENC (NVIDIA's hardware video encoding) to optimize PCIe bandwidth utilization by compressing data during transfer. The project implements
arXiv:2604.26103v1 Announce Type: cross Abstract: All current LLM serving systems place the GPU at the center, from production-level attention-FFN disaggregation to NVIDIA's Rubin GPU-LPU heterogeneou
arXiv:2604.23466v1 Announce Type: cross Abstract: NVIDIA's CUDA Tile (CuTile) introduces a Python-based, tile-centric abstraction for GPU kernel development that aims to simplify programming while ret
* 본 아티클의 원문은 2026년 4월 23일 Google Cloud 블로그(영문)에 게재되었습니다. AI는 질문에 답하는 수준을 넘어 추론하고 행동하는 단계로 진화하고 있습니다. 오늘날의 에이전틱 시대(agentic era)를 선도하고자 하는 기업에는 이러한 새로운 요구사항에 맞춰 설계되고 최적화된 컴퓨팅 인프라가 필요합니다. 오늘 Google Cloud
arXiv:2604.24169v1 Announce Type: new Abstract: 3D point cloud perception remains tightly coupled to custom CUDA operators for spatial operations, limiting portability and efficiency on non-NVIDIA, AM
DAVIS, APRIL 25, 2026 — InferenceX has added DeepSeekv4 for @vllm_project 's day 0 support for GB200 disagg! Great work to @flowpow123 @rogerw0108 @NVIDIAAIDev @inferact for the fast support and engin
Enterprises are rapidly moving from an artificial intelligence that answers questions and generates content to one that performs tasks and takes actions. According to Google Cloud Chief Executive Thom
As enterprises pivot from AI experimentation to production deployment, AI storage infrastructure is emerging as the critical bottleneck determining whether massive chip investments deliver real return
This post appears to be a humorous take on AI optimization and technology trends, likely referencing 'pixel-maxxing' (maximizing pixel-level performance or visual quality) in contrast to 'catfishing'
The Jensen + @dwarkesh_sp podcast was fantastic. Jensen is someone who understood how ecosystems work and someone who understands real-world trade, policy and controls work. And in some deeper sense h
Qianer Liu / The Information: Sources: Google is in talks with Marvell Technology to develop a memory processing unit that works alongside TPUs, and a new TPU for running AI models — Google is in talk
arXiv:2511.10909v2 Announce Type: replace-cross Abstract: Modern AI accelerators rely on matrix multiply-accumulate units (MMAUs), such as NVIDIA Tensor Cores and AMD Matrix Cores, to accelerate deep
Editor’s note: Today we hear from Perry Nightingale, SVP of Creative AI at WPP about the workflow that cuts training time for humanoid robots from days to minutes — plus access to the open-source code
Intel is so fucking back Long road ahead but @LipBuTan1 is the man for the job He is making many long term principled decisions Despite my long term optimism, I believe numbers won't be great in the s
arXiv:2603.22126v3 Announce Type: replace Abstract: Deploying learned robot manipulation policies in industrial settings requires rigorous pre-deployment validation, yet exhaustive testing across high
This is a r/ollama community support thread where a user is struggling to configure Ollama and Open WebUI together in Docker containers with NVIDIA CUDA/GPU acceleration enabled. Common issues in this
Together AI maintains a public events page at [together.ai/events](https://www.together.ai/events) listing its past and upcoming appearances, spanning major industry conferences such as NVIDIA GTC,...
European 78B A3.4B model is now supported by llama.cpp, I am waiting for some GGUFs https://huggingface.co/Aleph-Alpha/Kolibri-1 Kolibri is Aleph Alpha's mixture-of-experts (MoE) reasoning model, with
https://huggingface.co/Abiray/MOSS-Image-SFT-INT8-convrot I recommend the INT8 as a start. nVidia RTX20x+ & RDNA2 (RX6000)+ are good. ARM needs fairly recent GPUs to have the right OpCodes; Raspberry
A couple of weeks ago I read this Wccftech article about Patrick Moorhead's 4 Spark setup. I meant to post this a few days ago but ran some more tests first, and then my workstation had a problem afte
5/5 Across the board, results show the business impact and differentiation of sovereign specialized intelligence, and the opportunity for companies to reach AI independence. Thanks to @nvidia, @Gong_i