Knowledge catalogue
TensorSharp supports DSpark on Deepseek v4 Flash 0731 now. Here is the benchmark result on 4x Nvidia A40 GPUs, cuda 12.8 with/without DSpark: Model: DeepSeek-V4-Flash-0731-UD-Q8_K_XL from https://hugg
Hugging Face CEO Clément Delague says “AI is actually an opportunity to fix a lot of the cybersecurity problems” because his company used Nvidia’s version of a Chinese open model to defend itself agai
OPENAI IS GOING TO TAKE THIS ENTIRE MARKET DOWN WITH IT And you don't have to own a single share to get hurt. What I'm about to explain should worry anybody who thinks they're diversified: OpenAI is a
Artificial intelligence has propelled the cybersecurity world into a new phase, driven by startlingly advanced autonomous attacks and an urgent need to adopt technology to defend against them. This we
Figure 1: CUDA-to-MLX optimization translation map. CUDA optimization knowledge can be translated into architecture-native MLX strategies rather than copied instruction-for-instruction. We face a new
At AMD’s Advancing AI event, Lisa Su called her shot – just like Babe Ruth. The question now is whether AMD has built the engineering machine to hit it. Last week, we argued that AMD’s next reinventio
netflix’s stack In-House LLM Serving at Netflix Netflix built an in-house LLM serving platform using vLLM and NVIDIA Triton, integrating self-hosted models into its existing production infrastructure
🦔The cost of insuring Big Tech debt against default just hit record highs. Credit default swaps are insurance policies investors buy when they think a company might not pay back what it borrowed. When
’Tis the season of AI open letters and manifestos, apparently. Mark Zuckerberg has now entered the debate over the future of AI with a WSJ op-ed published today - and frankly, his position is much mor
創業以来、オープンソースコミュニティから多くを学び、また研究成果の公開を通じてそこに貢献してきました。オープンなエコシステムが健全なAI産業と技術主権を支える重要な基盤の一つであると考えており、その発展を支持します。 このたび、Sakana AIは、オープンウェイトAIモデルに関する公開書簡 「Open Weights and American AI Leadership」に署名しました。 書簡は
Attackers have frontier AI. Defenders need a frontier AI ecosystem—the best open and closed models, force-multiplied by a global community. During the Hugging Face incident, closed AI blocked essentia
I've been building Krasis, an MoE-focused runtime for streaming big models through limited VRAM on NVIDIA consumer/workstation GPUs, and I think this is the most interesting result so far: Ornith-1.0-
Nvidia Corp. today announced the launch of the Open Secure AI Alliance, a new organization founded by technology, cloud computing and cybersecurity leaders to build and share open artificial intellige
Hello, I've been learning how to use local LLMs for a year or so on my workstation, using a RTX3090. Current setup : - i5 12400 - 64gb RAM - RTX 3090 - OS : Fedora KDE workstation I'm using LMStudio t
Hey sir. We are not asking you to open source Anthropic. Just don’t lobby the government to shut down others who do. Jensen never framed other chips as “dangerous” or decides who can use CUDA based on
RTX 4070, 32gb system ram, Linux. NVIDIA-SMI 610.43.03, KMD Version: 610.43.03, CUDA UMD Version: 13.3 Systemd service modifications: [Service] Environment='OLLAMA_HOST=0.0.0.0:11434' Environment='OLL
Wonderful to have a broad base acknowledgement of the need for open weights. We are delighted to support as signatories. Open weights is the key to ensuring security, research, innovation and competit
Ashley Capoot / CNBC: In their letter defending open-weight AI, tech companies urge lawmakers to avoid “premature restrictions” that “stifle competition or drive innovation overseas” — Nvidia, Microso
Open weights = freedom. You can run them on your own hardware. No vendor can pull the plug. No API can deprecate you. No company logs your private data. That's sovereignty. Closed models hand one comp
NVIDIA AI has released Cosmos 3 Edge, a 4‑billion‑parameter open‑source world model designed for on‑device inference. It enables robots to learn and act, autonomous vehicles to interpret road scenes a
Huge if true! We are talking about a 27B multimodal model that runs locally on a phone. That's wild! Bonsai 27B reaches up to 163 tok/s in 1-bit and 134 tok/s in Ternary on an NVIDIA GeForce RTX 5090.
Hugging Face Gemma Challenge results are in! 📈 Over 6 days, more than 100 AI agents and humans collaborated to make Gemma 4 inference 5x faster on a single NVIDIA A10G GPU. - Fastest result: 491.8 TPS
Artificial intelligence training startup Prime Intellect Inc. has raised 130 million in funding from a group of prominent investors. The consortium included Nvidia Corp.’s NVentures, Intel Capital and
The model has an advisor tool that natively escalates to a stronger model when needed. This model is hosted in the U.S. by Perplexity on Nvidia B200 GPUs. We will improve the model in research preview
Congrats to prime intellect! Love partnering with them on LangChain labs work Announcing our $130M Series A to build the Open Superintelligence Stack Led by Radical Ventures, with NVIDIA, Intel Capita
arXiv:2607.06202v1 Announce Type: cross Abstract: The deployment of Mixture-of-Experts (MoE) models on production high-bandwidth superpods, such as NVIDIA's NVL72/576 and Huawei's CloudMatrix384, intr
We're releasing ZML/LLMD, our homegrown LLM server built on top of our homegrown high performance heterogeneous inference stack. It ships with 5 architectures out of the box: NVIDIA, AMD, Metal, Intel
Creative structures are needed to get GPUs in the hands of startups + other companies that aren't Meta, OpenAI, Anthropic, SpaceXAI, Microsoft, Amazon, Google AI Debt Financing will be over $7T of deb
The Nemotron model family from NVIDIA has reached 100 million downloads, marking a significant milestone for the open-source AI model community. The achievement reflects growing adoption and collabora
Don't forget, we'll be in Paris for @RaiseSummit. Will we see you there? Going to be in Paris for @RaiseSummit? Join us and @nvidia to hear from leaders at both companies on the future of AI inference
This video from Two Minute Papers discusses groundbreaking research by NVIDIA that achieves a 100x speedup in physics-based character animations using AI-powered super-resolution applied to physics si
arXiv:2606.23672v2 Announce Type: replace Abstract: This paper presents our algorithmic innovations for the NVIDIA Nemotron Model Reasoning Challenge, focusing on Bit Manipulation Puzzles. In this tas
Dina Bass / Bloomberg: AI inference startup Etched raised 800M from investors including Jane Street and a TSMC-linked venture firm, and says it has signed sales contracts worth 1B — Nvidia rival says
Apple. Anthropic. Disney Research. Google. Meta. Microsoft. NVIDIA. OpenAI. Few places outside Silicon Valley can claim R&D hubs from all of these companies. Fewer still are concentrated in a city of
Chess engines tell you the best move. But grandmasters are human, they don’t always play it. So I built 'Kibitz': a human move predictor for chess broadcasts. I trained this model on my Nvidia RTX 508
arXiv:2606.23698v1 Announce Type: cross Abstract: NVIDIA's Blackwell Ultra (B300) cuts FP64 vector throughput to ~1.3 TFLOPS per GPU, roughly 30x below B200 and well below the level at which bandwidth
New research explores how game theory can optimize NVIDIA Dynamo disaggregated serving architectures, revealing critical performance thresholds and reducing worst-case AI inference latency by up to 7.
Seven months after inking a 20 billion chip licensing deal with Nvidia Corp., Groq Inc. today announced that it has raised 650 million in funding. Growth investment firm Disruptive and hedge fund Infi
Me, 2024. LLMs will be commodity; (except for Nvdia) profits will be hard to squeeze out. Techbros: Shut up, Gary. GPT-5 is gonna be AGI. Today: LLMs are commodity; (except for Nvidia) profits have be
This article from SemiAnalysis tracks the performance evolution of DeepSeek V4, a 1.6 trillion parameter model, over its first 43 days of training on Huawei and NVIDIA hardware including GB300 NVL72,
for those keeping track at home it was 34 days between signing this deal and launching Mythos-class model GA to the world. https://x.com/leerob/status/2052059466821198061?s=20 building on @nvidia stac
GPU MODE has powered much of the public GPU kernel work online, with a permissive license from day one and generous credit from researchers, NVIDIA, AMD, and others. Today we’re moving our datasets to
A developer documented their experience building a fully-local paper Retrieval-Augmented Generation (RAG) system using two NVIDIA GTX 1080 Ti GPUs and one RTX 3090, sharing three significant challenge
“I've tried to find where this stops being circular and I can't.” 🦔Google signed a deal to pay SpaceX 920 million a month for access to 110,000 Nvidia GPUs at SpaceX data centers. The contract runs Oc
They said the reason for the sell off was about interest rates , but I agree with @GaryMarcus that it might be about the faltering IPOs prospects... Absolutely brutal day for AI fantasies: Nvidia NVDA
This guide explains how to adapt NVIDIA's Nemotron 3.5 Automatic Speech Recognition (ASR) model to specific languages, domains, or accents through fine-tuning techniques. It likely covers the fine-tun
Nemotron-3-Ultra is a large language model available through Ollama's model library, likely representing an advanced iteration in NVIDIA's Nemotron model series optimized for performance and capabilit
Nemotron 3 Ultra, NVIDIA's advanced language model, is now accessible through Vercel's AI Gateway, enabling developers to integrate this model into their applications alongside other LLM options. The
Nemotron 3.5 Content Safety is NVIDIA's multimodal safety solution designed for enterprise AI applications, offering customizable safeguards for both text and image inputs across different global cont
Sawdah Bhaimiya / CNBC: Marvell shares closed up 32.52% on Tuesday after Jensen Huang hailed the chipmaker as the “next trillion-dollar company” at Computex — Nvidia's CEO Jensen Huang hailed Marvell
Microsoft only just announced a new Surface Laptop Ultra at the weekend, and it's now revealing a miniature Surface PC aimed at developers. The new Surface RTX Spark Dev Box is powered by Nvidia's new
Cosmos3-Super-Image2Video is an omnimodal world model capable of generating video from combinations of text and image inputs . The model is designed to run on workstation-grade compute like the NVIDIA
🆕Grok Imagine’s Video Agent Moment: Cosmos, xAI, World Models, Generative UI, & the Codex Phase for Video! https://www.latent.space/p/video-agents @EthanHe_42, former @xai world model lead and @nvidia
So much great work lately from Nvidia, the 'King of American Open-source AI'! - Crossed 1,000 total public repositories on @huggingface (820 models, 249 datasets & 57 spaces) & almost 60,000 followers
Nemotron 3 Ultra is NVIDIA's latest language model featuring significant improvements in speed (5X faster) and cost efficiency (30% cheaper) compared to previous versions, positioning it as a frontier
the decade of agents! @theemozilla We have been working closely with @nvidia to ensure Hermes Agent works smoothly on their new @NVIDIARTXSpark superchip and integrates with the new OpenShell runtime,
Nvidia's announcement that it's getting into the consumer laptop chip space with RTX Spark is huge. Apple has proved for years that Arm-based chips can perform incredibly well while also delivering gr
We 💚 open source So much great work lately from Nvidia, the 'King of American Open-source AI'! - Crossed 1,000 total public repositories on @huggingface (820 models, 249 datasets & 57 spaces) & almost
and see, perhaps further reflection of the death of tokenmaxxing The price to rent an Nvidia H200 just collapsed from 7/hr to 4/hr in three weeks. A -40% drop in the cost of the single most strategic
Gary Marcus discusses declining prices for NVIDIA's H100 and H200 AI chips, suggesting that inflated valuations and returns on investment for AI hardware customers are becoming unsustainable as the ma