netflix’s stack
netflix’s stack In-House LLM Serving at Netflix Netflix built an in-house LLM serving platform using vLLM and NVIDIA Triton, integrating self-hosted models into its existing production infrastructure
Knowledge catalogue
netflix’s stack In-House LLM Serving at Netflix Netflix built an in-house LLM serving platform using vLLM and NVIDIA Triton, integrating self-hosted models into its existing production infrastructure
arXiv:2607.23445v1 Announce Type: cross Abstract: Omnimodal large language models (OmniLLMs) are rapidly extending multimodal reasoning to cover synchronized audio and video. However, the resulting au
arXiv:2607.23193v1 Announce Type: new Abstract: Existing token compression methods for omnimodal large language models typically rely on one modality to determine what to retain in the other. We show
OpenWiki supports 12 LLM providers: - @OpenAI API & @ChatGPT sub login - @AnthropicAI - @GeminiApp AI Studio & Enterprise Vertex - @awscloud Bedrock - @OpenRouter - @FireworksAI_HQ - @baseten - @nebiu
As a discerning AI investor who values style and substance, Sarah Guo knows this season’s standout accessory isn’t the latest designer purse — but what’s inside it. In a recent video, Guo, founder of
arXiv:2607.24249v1 Announce Type: new Abstract: Standard depth sensors systematically fail on transparent surfaces, creating corrupted 3D maps and severe navigation hazards. While specialized hardware
arXiv:2607.22913v1 Announce Type: new Abstract: Detecting pollinators in field video is challenging: targets are small, visually similar, and observed against cluttered vegetation under blur and occlu
arXiv:2607.22584v1 Announce Type: new Abstract: Standard Retrieval-Augmented Generation pipelines rank retrieved documents by semantic similarity alone, without accounting for source provenance or cre
arXiv:2607.22864v1 Announce Type: cross Abstract: Multimodal large language models (MLLMs) excel at visual interpretation but fail on spatial reasoning tasks that humans solve reliably. Existing bench
🦔The cost of insuring Big Tech debt against default just hit record highs. Credit default swaps are insurance policies investors buy when they think a company might not pay back what it borrowed. When
arXiv:2607.24396v1 Announce Type: cross Abstract: In deep learning, efficiency gets more and more important to compensate for the ongoing growth in model sizes and applications. Neuromorphic hardware
We recently joined NVIDIA, Microsoft, and others in supporting open-weight AI. Today, we’re putting that belief into the product with model choice on Replit, starting with Kimi K3. The future is the r
arXiv:2607.23264v1 Announce Type: cross Abstract: Fine-grained, device-initiated communication lets persistent GPU kernels in distributed diffusion transformer (DiT) inference issue remote stores and
Applied Materials and NVIDIA have created an end‑to‑end digital development platform that unifies GPU‑accelerated tools (Ginestra, cuDSS, cuEST, PhysicsNeMo, Omniverso) with CUDA‑X libraries to accele
AI security improves when organizations share research, tools and real-world experience. We’re joining industry leaders, including @NVIDIA, in the Open Secure AI Alliance to help organizations identif
Attackers have frontier AI. Defenders need a frontier AI ecosystem—the best open and closed models, force-multiplied by a global community. During the Hugging Face incident, closed AI blocked essentia
Hi everyone! 👋 I built and trained the complete Transformer architecture from scratch using pure PyTorch (`torch.nn` primitives) based on the original 'Attention Is All You Need' paper. I trained the
Good move by @JensenHuang. The Nvidia letter is well written and worth reading. As we saw with the OpenAI-Hugging Face hack, we need open models and harnesses for defense. Lets stop believing the PR t
If you look at the current lead times for ~$5bn per year of cutting edge GPUs you can probably figure out the time plus one training run to IlyAGI We are announcing a long-term strategic partnership w
Make Kimi K3 yours with LoRA training on Fireworks Training a model this massive used to be a big project. With Fireworks Training, you can take the best open model in the world and efficiently tune i
Nvidia Corp. is reportedly in talks to backstop a 250 billion loan for OpenAI Group PBC. The Wall Street Journal on Sunday cited sources as saying that the financing would cover the cost of a new data
The complexity of modern chip design continues to grow as engineering teams work to develop increasingly sophisticated CPUs, GPUs and AI systems. To help meet that challenge, NVIDIA is collaborating w
Nvidia Corp. said tonight it’s now running the chip design software its engineers are using to design the next generation of its graphics processing units, on its own silicon. It’s partnering with Cad
NVIDIA Ising Calibration 1.5 is a 31‑billion‑parameter vision‑language model that diagnoses and tunes quantum processors, delivering state‑of‑the‑art zero‑shot and in‑context learning on the QCalEval
Keach Hagey / Wall Street Journal: Nvidia says it made a “substantial” investment in Safe Superintelligence, which will get access to Nvidia GPUs to up computing power by an “order of magnitude” — Par
The artificial intelligence competition is no longer between large language models, but rather between AI systems. Advanced Micro Devices Inc. has shifted from being primarily a chip business to a sec
Proud to be an inaugural partner alongside @NVIDIA and other industry leaders in the Open Secure AI Alliance. We look forward to accelerating the adoption and trust of open models and harnesses throug
Proud to join @nvidia as a founding member of the Open Secure AI Alliance. Defenders need open tools, collaboration, and transparency to secure AI agents and systems. And customers want the ability to
arXiv:2607.22484v1 Announce Type: cross Abstract: Singular value soft-thresholding can be computed via a reduction to the matrix polar decomposition, which allows one to exploit GPU-friendly algorithm
The performance of AI agents depends not only on the underlying models but also heavily on their “harness”—the surrounding architecture that supplies context, state management, action execution, and t
Shirin Ghaffary / Bloomberg: Sources: Nvidia has committed to invest 5B in Ilya Sutskever's SSI; the startup has previously raised about 3B in funding and was valued at 32B last year — Nvidia Corp. ha
As AI infrastructure matures, AI cloud strategy is increasingly defined by reliability and open ecosystems rather than raw GPU performance. That evolution is creating new opportunities for specialized
arXiv:2607.21985v1 Announce Type: cross Abstract: The increasing deployment of large language models (LLMs) has magnified the computational and memory bottlenecks of autoregressive decoding, where low
We're proud to join @NVIDIA and the Open Secure AI Alliance. To support open source models, we're contributing our research on measuring the trustworthiness and security of open source models. Closing
Would I be too cynical in thinking that the whole thing might fall apart if Nvidia wasn’t subsidizing? 🤔 JUST IN : NVIDIA IN TALKS TO PROVIDE 250 BILLION FINANCIAL BACKSTOP FOR OPENAI DATA CENTER IN O
It continues to boggle the mind how many people, who otherwise seem to have a functioning intellect, appear to lose all cognitive capacity when it comes to thinking about actions that impact the compa
Wall Street Journal: Sources: Nvidia is in talks to provide a ~$250B backstop for OpenAI as part of a 10 GW data center project that SoftBank is developing in Ohio — Project would be one of the larges
Hey everyone, I have been looking into how people source compute for their Inference workloads (and in general). I wanted to understand some specific pain points here. If you've used online services l
The market for data center GPUs is evolving beyond individual chip specifications into a contest over fully integrated rack-scale systems. As AI workloads scale into the gigawatt range, buyers increas
Title: “don’t do this” refers to a conversation on Twitter where Jerry Liu warns against a particular action, while Julian Schrittwieser comments on a separate thread expressing excitement that Jensen
Hey sir. We are not asking you to open source Anthropic. Just don’t lobby the government to shut down others who do. Jensen never framed other chips as “dangerous” or decides who can use CUDA based on
I wanted to challenge myself and see how far I could push Krea 2 and LTX 2.3, so I decided to create a short cinematic action trailer. It ended up being one of the most enjoyable AI projects I've work
I've spent the last year or so playing around with open source MLX and GGUF models on iPhone hardware. Given the limitations in memory, GPU/CPU/ANE, and in turn the context window I've been trying to
“open source shouldn’t be banned” != “everything must be open source” but also to NVidia credit big parts of the toolchain are increasingly open source: driver, cutedsl kernels, etc I’m so excited tha
New York Times: Sources: OpenAI and Anthropic quietly lobby Washington regulators to restrict open-source AI models, even as Sam Altman publicly says he supports open source AI — Anthropic and OpenAI
Quantized Krea 2 Turbo checkpoints for ComfyUI, up to 2x faster and about a third smaller than the usual FP8 version — no calibration dataset, no quality cliff. How to use it (short version): clone th
Maybe Nvidia ultimately won’t win the entire AI enchilada, even as it reminded everyone this week that it offers everything you need to build AI factories. This week, Advanced Micro Devices also annou
At this week’s AI Summit in San Francisco, South Korean President Jae Myung Lee and some of the country’s top business leaders and researchers are meeting with NVIDIA and ecosystem partners to chart K
Congrats to @lmstudio on Bionic! Put open models to work with a local-first agent for docs, coding, voice, and more. Run it today on NVIDIA RTX GPUs. 🚀 Meet LM Studio Bionic. The Agent made for Open M
arXiv:2607.20527v1 Announce Type: new Abstract: Agentic LLM systems such as OpenScholar and PaperQA2 read the scientific literature and return cited answers, and both they and their benchmarks already
arXiv:2607.21446v1 Announce Type: cross Abstract: Post-training quantization (PTQ) of diffusion transformers (DiTs) to W4A4 severely degrades output quality, because activations entering each linear l
Leo Schwartz / The Information: Meta, Nvidia, Microsoft, a16z, and others sign a letter defending open-source AI; Jensen Huang, in his first X post, says open models strengthen cybersecurity — Many of
NVIDIA ModelExpress (MX) is an agentic AI platform that streamlines the lifecycle of large‑model weights by automatically locating and using the fastest path to load them—prioritizing GPU‑to‑GPU P2P R
Reuters: Nvidia and SK Group unveil a 500B+ AI initiative that includes an SK Hynix partnership to secure next-gen memory supply for Nvidia and joint development of HBM — Nvidia (NVDA.O) and South Kor
arXiv:2607.20709v1 Announce Type: new Abstract: Traditional agent development is split across prompt templates, tool schemas, callback code, and workflow graphs. We present NVIDIA Object-Oriented Agen
Ian King / Bloomberg: Nvidia plans to invest 1B in Naver to help finance an AI data center in South Korea, and partners with SK Group to build more than 2 GW of AI data centers — Nvidia Corp. will inv
On July 24 2026, a tweet from NIK @ns123abc reported that OpenAI declined to sign NVIDIA’s “open weights” letter. Instead, the company is reportedly lobbying government authorities to ban open‑AI tech
arXiv:2607.21354v1 Announce Type: new Abstract: For years, supply chain planning at e-commerce firms has operated as a collection of isolated projects. Each planning task from static network planning
The rapid evolution of intelligent software-defined systems is pushing chip design into a new era of physical AI, one where chip design complexity is outpacing traditional engineering methods. Manufac
arXiv:2512.16615v2 Announce Type: replace Abstract: Diffusion Transformers (DiTs) set the state of the art in visual generation, yet their quadratic self-attention cost fundamentally limits scaling to