Search: “hardware”

Together AI, in partnership with NVIDIA and Lyra Lab, hosted a fireside chat led by Tri Dao discussing current trends and future directions in AI research and infrastructure development. The event bro

“We were going to run out of money.” Groq was 3 weeks away from death and @JonathanRoss321’s leadership team put together a list of layoffs that also would have killed the company. He realized that th

Groq Founder @JonathanRoss321 explains why all the West Coast VCs missed on investing in Groq: “Typical West Coast VCs are more like lemmings. Ttypical East Coast VCs all think that they're smarter th

This post showcases an early animation demonstration from a C++/CUDA implementation of PyTTI (Python Text-to-Image), utilizing CLIP cutout techniques in the style of DD (likely referring to a specific

This post likely references the patriotic phrase from the U.S. national anthem, possibly in the context of Dylan Patel's technology industry commentary or analysis. Without access to the specific cont

The July 4th weekend All-In @theallinpod turned into a long argument about who owns the intelligence layer. The besties think enterprises just woke up to a trap they had been walking into, here's how

Wow… this is amazing This latest episode of the @theallinpod is a complete referendum of closed source AI (ie. Anthropic/OAI) in a way I haven’t yet heard from industry leaders Open source AI is about

Don't forget, we'll be in Paris for @RaiseSummit. Will we see you there? Going to be in Paris for @RaiseSummit? Join us and @nvidia to hear from leaders at both companies on the future of AI inference

We're releasing the full slides for our 2 hr deepdive session from the AI Engineer World's Fair. We covered how we build inference engines to serve agentic workloads at trillion token production scale

🌍 World’s Largest Hermes Buildathon 10 cities. 5 countries. $750K credits Backed by OpenAI, Convex, Cloudflare, ElevenLabs, Linkup, Dodo Payments, Hissa Fund & Wispr Flow. Proudly presented by GrowthX

ParallelKernelBench is a benchmarking framework designed to evaluate large language models' ability to generate optimized GPU kernels for multi-GPU computing environments. The benchmark assesses LLMs

Dylan Patel, a notable tech industry figure, was visited by the post author (Sassine Ghazi), and they had a positive conversation together. The post appears to be a casual social media update sharing

Our research team has 9 papers at ICML next week! Spanning the full stack from frontier agents to GPU kernels, we're excited to share what our researchers and collaborators have been working on. If yo

When boomer companies get high Anthropic bill, they set spend limits When I see a nearly million dollar Anthropic monthly bill, my first reaction is to complain about use of shitty Haiku models Imagin

Featuring the man of the moment @dylan522p @shaunmmaguire in today's Training Data episode. Nobody is a more trusted industry insider to the biggest infrastructure build-out in history. The story of h

Project gallery and whitepaper: https://research.nvidia.com/labs/gear/aspire/ ASPIRE is a great collaboration between NVIDIA GEAR lab, UMich, Berkeley, and CMU. Kudos to all the coauthors who pour the

Dylan Patel discusses concerns within the AI startup ecosystem about potential Chinese AI model bans and their impact on companies generating significant revenue. The post appears to address industry-

Going to be in Paris for @RaiseSummit? Join us and @nvidia to hear from leaders at both companies on the future of AI inference and infrastructure. After that: cocktails and a DJ. Oh la la! See you th

Nvidia CEO Jensen “@Tesla stack is the most advanced autonomous vehicle stack in the world. I’m fairly certain they were already using end-to-end AI. Whether their AI did reasoning or not in somewhat

One day left to submit your projects for the Hermes Agent Accelerated Business Hackathon presented by @NVIDIAAI × @stripe × @NousResearch! Submissions close 11:59 PM PT tomorrow, June 30th. Last minut

This post humorously contrasts the competitive achievements people in San Francisco boast about—such as winning the International Mathematical Olympiad, achieving high competitive programming ratings,

NEW paper from NVIDIA. (bookmark it) Speed-of-light performance analysis tells you the theoretical floor of a workload, but teams still derive it by hand and freeze it. SOLAR automates the whole thing

Dylan Patel responds to criticism or skepticism (represented as 'negative Nancy') with an optimistic counterargument (playing on his own name as 'positive Patel'), likely defending a bullish outlook o

Adding my voice to the chorus who are saddened by @Om’s too-early passing. Just heartbroken to hear of the passing of the incredible Om Malik. @Om was always a pioneer, a deep thinker, and a truly ori

BREAKING NEWS: OpenAI’s Technical Lead for Compute has returned to OpenAI after joining Meta in April 2026. What is going on at Meta that people are quitting after only a couple of months? Did Anuj ge

“Scale cannot solve AI’s fundamental problem with accuracy” If my argument @financialtimes, excerpted below, is remotely correct, hyperscaling will prove to be among the biggest financial blunders in

NVIDIA has released GLM-5.2 NVFP4, a new quantization format for large language models. The announcement invites comparison with alternative quantization methods for performance and efficiency evaluat

Disagree with @mcuban’s opening sentence – I do think some people genuinely hate the noise, blight, impact on electric prices, etc—but he is quite right that data centers have become a proxy for hate

People don't quite understand how many behind the meter power generation assets are being built for datacenters because the US Grid sucks, despite the higher cost and complexity. US Grid Constraints:

Without a doubt: A world running foundation models on a billion robots won't be doing it locally. None of the embedded compute will look like it does today. All of the embedded compute will be wireles

All DOGE required was contact information of the recipients to confirm that funding was not fraudulent. No validated medical funding was stopped. Anything that appeared to be legitimate lifesaving fun

.@cartesia runs one of the hardest inference workloads: real-time voice. Their stack has to keep long-lived streams moving, serve millions of audio minutes a day, and hold model latency around 90ms. T

i dont think anyone is correctly doing the math around how SpaceX, the NeoCloud+NeoLab, is currently going to market? SpaceX has already recouped about HALF its investment in Cursor, in compute deals.

LLMs write fast single-GPU kernels. Ask for a multi-GPU one and they fall apart. ParallelKernelBench (PKB) measures how they fail by benchmarking against 87 problems pulled from real codebases includi

We were honored to welcome His Royal Highness Crown Prince Al Hussein bin Abdullah II and Her Royal Highness Princess Rajwa Al Hussein to Replit in Silicon Valley. It was a privilege to share how AI i

GLM 5.2 x AWS GLM-5.2 is accessible via http://Z.ai GLM API on AWS Marketplace 🚀 Powerful long-horizon autonomous workflows, top-tier coding & multi-step agent reasoning capability, delivered through

GPU rental prices have declined according to a GPU rental index tracked by Gary Marcus, indicating decreased demand or increased supply in the cloud computing market. This trend suggests potential shi

Gary Marcus discusses potential competitive threats to CoreWeave, a GPU cloud computing company, from SpaceX's large GPU contracts and infrastructure investments. The post likely examines how SpaceX's

Join us in our Discord this time tomorrow for Office Hours! Our topic will be the @NVIDIAAI × @stripe × @NousResearch Hermes Agent Accelerated Business Hackathon which concludes at the end of the mont

The next generation of inference needs purpose-built infrastructure. Together AI and 5C are deploying NVIDIA GB300 NVL72 systems with high-density compute, advanced cooling, and AI-optimized storage f

True Water usage has been a hot topic in the AI data center world, but the numbers may surprise you. According to the Manhattan Institute, data centers use 0.2 percent of daily water usage in the U.S.

This post speculates about a potential GTA 6 DLC called 'Scili Valley' based on leaked information, with the author expressing enthusiasm about its potential as a gaming experience. The post appears t

MaineCoon is the first video model that focuses on social interactions: facial expressions, emotions, fluid conversation, audio-lip sync, etc. Really impressive inference specs: 22B params, 47.5 FPS o

Hot take: GLM 5.2 might be the first open/public model that actually changes the enterprise AI cost equation. I played with it for a few hours today after friends told me to stop ignoring it. I expect

This post likely presents a humorous or satirical perspective on experiencing computing systems based on the von Neumann architecture during a hypothetical memory shortage in 2026, possibly commenting

Speculation Is All You Need. In this blog post, we announce the co-release (w/ Z Lab) of six more state-of-the-art DFlash speculators for @Alibaba_Qwen 3.x. Over 1k output tps for 3.5 122B-A10B on a B